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PREFACE 


This  handbook  is  intended  as  a  guide  for  de\ermining  reliaoility  of  functioning  characteris¬ 
tics  of  weapon  components  by  testing  to  failure. 

Component  reliability  of  weapon  systems  is  basically  a  function  of  engineerirn  design. 
Margins  of  safety  used  in  engineering  design  to  create  high  reliabilities  must  be  mcajui  ed  by  testing 
to  failure  techniques  to  obtain  unbiased  estimates  of  reliability. 

The  author  does  not  hold  that  the  concepts  and  principles  presented  herein  are  final. 
Revisions  will  inevitably  be  made  as  the  state  of  the  art  advances. 


SUMMARY 


1 .  -The  following  are  set  forth: 

a.  The  concept  of  reliability  of  functioning  characteristics  of  weapon  components  in  terms 
of  stress  and  strength, 

b;  The  operating  engineering  definition  of  reliability; 
c.  The  complex  nature  of  reliability; 

Ultir"-’»e  reliability  in  terms  of  safety  margins; 
e,  The  relatijr.ihip  between  test  and  use  conditions.’  >  ■ 

f)  The  limitations  of  reliability  determinations  imposed  by  testing  facilities,  information 
and  cost. 

2.  A  two-phase  testing  procedure  which  meets  the  need  for  demonstrating  high  reliabilities  with 
small  sample  sizes  is  describe,  in  a  rational,  objective  manner.  The  first  phase  involves  use  of 
fractional-factorial  experimental  designs  to  survey  effects  of  important  environments.  The  second 
phase  is  a  test-to-failuro  procedure  (using  the  environment  found  most  severe  in  the  first  phase) 

so  conducted  that  reliability-in-use  can  be  calculated  from  test  results. 

t  <• 

3.  The  need  to  plan  experiments  in  advance  of  data  collection  and,  to  test  to  failureand  empha¬ 
sized.  The  requirements  of  a  good  experiment  are  treated.  -  ;  '  • 

4.  Several  useful  fractional-factorial  test  plans  are  completely  laid  out  in  the  form  of  treatment 
procedures.  Tests  of  increased  severity  most  useful  in  testing  to  failure  are  described.  Examples 
are  given  for  applying  these  methods. 

5.  -Useful  statistical  tables,  a  glossary  of  terms,  and  a  list  of  references  are  included.  — 
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INTRODUCTION 


This  handbook  -hes  been  prepared  for  those  engineers  and  scie '  tists  conducting  reliability 
experiments  who  would  like  to  use  statistical  techniques  to  improve  ihe  efficiency  of  their  experi¬ 
ments.  Howev'er,  it  is  advisable,  especially  in  the  planning  stages  of  testing  programs,  to  supple¬ 
ment  the  information  in  this  manual  by  oc''asionai  consultations  with  a  statistician. 

Planning  experiments  in  the  modern  ?v'tis;ical  sense  compclstheexperimenterexplicitly  to 
formulate  his  objectives  and  the  procedures  i ^  ^uired  to  attain  »nem.  This  often  leads  to  tha 
recognition  of  fallacies  and  other  difficulties  in  advance  of  data  collecting. 

The  statistical  aspects  of  reliability  are  not  new.  Ail  of  the  necessary  concepts  are 
adequately  treated  in  modern  statistical  literature.  The/ac<r  of  information  about  measurable 
characteristics  of  the  missile  system  and  the  enyironment  it  experiences  in  use,  as  well  as  the 
high  cost  of  test  specimens,  have  created  the  current  problems. 

The  techniques  described  in  this  manual  are  the  most  efficient  known.They  are  designed 
to  maximize  the  amount  of  inforrriation  obtainable  from  a  given  sample  size.  Very  high  reliabili¬ 
ties  (0.9999  and  higher  if  they  exist)  can  be  demohstrated  from  very  small  sample  sizes  (25  to  30 
items}.  In  addition,  these  techniques  are  definitive  enough  to  serve  as  standard  procedu'^es  through¬ 
out  the  same  or  different  organizations  ovar  extended  periods  of  time. 

Uniform  application  of  these  techniques  is  as  important  as  their  efficiency.  A  large  part  of 
the  value  of  experimentally  determined  i  eliability  data  i-s  the  scope  of  applicab'lity.  Reliability 
data  collected  by  means  of  standardized  procedures  are  cumulative  in  the  matheiTKtical  sense. 
Hence,  the  precision  with  which  reliability  values  are  known  can  be  improved  with  time  as  addi¬ 
tional  data  are  collected.  This  makes  it  pcssibla  to  accumulate  a  reference  file  of  reliability  data 
on  a  variety  of  standard  components. 

For  those  readers  not  thoroughly  familiar  with  statistical  terms  a  glossary  of  these  terms  has 
been  included  in  Appendix  2. 

1.  RELIABILITY  CONCEPT  , 

It  is  assumed  that  for  every  missile  component  there  exists  a  true  but  unknown  "strength" 
created  by  the  particular  (parts)  design  developed  and  used  by  the  engineer  in  building  the  com¬ 
ponent.  It  is  further  assumed  that  the  true  "strength"  is  a  constant  and  not  a  random  variable  for 
any  particular  design  over  short  periods  cf  time. 

An  item  will  not  fail  until  the  applied  stress  exceeds  the  items  "strength."  If  the  "strength" 
is  much  greater  than  the  stress  expected  to  be  experienced  in  use,  the  chance  (probability)  of  failure 
in  u»  is  very  small,  and  the  chance  of  success  (reliability)  is  very  high,  it  is  in  this  sense  that  "high 
reliability"  is  defined.  That  is,  high  reliability  mean>  high  probability  of  successful, functioning 
under  actual  use  conditions;  it  does  not  mean  high  reliability  under  the  rest  conditions. 
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RELiABILILITY  DEFINiTfON 


The  accepted  statistical  definiticr  of  reliability  Is  that  reliability  is  "the  probability  of  sue 
cessful  functioning  in  use."  This  is  a  general  definition  that  is  applicable  any  operating, system 
However,  to  define  reliability  from  an  operating  engineering  point  of  view,  the  general  definition 
must  be  modified  to  include: 

3.  The  en'-ironmentai  conditions  under  which  succes'ful  functioning  is  required. 

b.  The  characteristics  that  are  reqt  'red  to  function  successfully 

c.  The  '  ngth  of  time  or  tha  number  of  times  successful  functioning  is  required. 

d.  When  successful  functioning  is  required. 

This  means  that  every  component  can  have  as  many  reliabilities  as  a  number  equal  to  the 
possible  combinations  of  environmental  conditions,  measurable  characteristics  and  functioning 
times. 


Under  the  definition  that  an  item  cannot  fail  until  the  stress  exceeds  its  strength,  the  re¬ 
liability  with  respect  to  any  environment  can  be  determined  only  if  the  test  specimens  are  stressed 
by  that  environment  until  failure  is  obtained.  This  means  that  successively  higher  levels  of  severity 
must  be  used  until  failure  is  obtained,  as  in  the  applications  of  successively  greater  loads  until  failure 
is  obtained  in  a  tensile  test.  When  the  magnitude  of  the  stress  at  the  point  of  failure  cannot  be 
directly  observed,  then  an  exploratory  type  test  such  as  the  Bruceton  up  and-down  method  is  re¬ 
quired.  This  procedure  generates  the  failure  rate  curve  from  which  the  average  (ultimate)  strength 
(the  point  at  wnich  the  stress  equals  the  strength)  can  be  obtained  by  finding  the  stress  at  which 
50  perre.1t  of  the  items  fail.  In  any  case  the  ultimate  strength  of  an  item  is  determined  in  such  a 
manner  that  the  reliability-in-use  can  be  predicted  from  the  test  results. 


3.  LIMITATIONS 


A.  Laboratory  Testing 

In  laboratory  testing,  it  is  difficult  to  reproduce  the  corulitions  which  components  will 
experience  operationally.  In  use,  several  environments  occur  simultaneously;  in  the  laboratory, 
the  environments  usually  have  to  be  applied  in  sequence.  As  a  result,  the  environment  experienced 
in  use  is  more  severe  than  that  applied  at  comparable  levels  of  severity  in  the  laboratory.  Further¬ 
more,  interactions  among  environments  and  among  components  raise  the  level  of  severity  ex¬ 
perienced  in  use  by  an  additional  amount.  The  extent  to  which  the  level  of  severity  is  increased 
In  these  cases  is  usually  not  known. 


3 


To  ropf,  wtth  unknowns  of  this  kind,  enoineers  use  "margins  (or  factored  of  safet\’''''  to  assure 
successful  functioning  in  use.  As  a  rational  consequence,  testing  procedures  used  to  test  compon¬ 
ents  must.  iO  be  of  any  valued  determine  the  actual  margins  of  M^ety  the  engineers  ha^re  succeeded 
in  building  into  the  new  item.  To  accomplish  this,  with  the  limitations  imposed  by  cost  considera¬ 
tions,  ccrefui  planning  prior  to  data  collection  is  required.  Useful  and  realistic  component  reliabi¬ 
lity  values  cannot  be  obtained  by  accident  or  as  a  by-product  of  a  testing  program  designe  d  for 
some  other  purpo-«,  such  as  controlling  quality.  However,  reliability  values  pan  supplement  bui  not 
replace  quality  control  and  other  engineering  inform.ation. 

B.  Information 

A  complicated  system  of  any  kind  cannot  be  fully  characterized  or  described  by  a  single 
numerical  value.  Just  as  the  "whole  man  cannot  be  fully  described  by  an  intelligence  quotient, 
a  whole  missile  system  cannot  be  ful'y  described  or  characterized  by  a  single  reliability  value. 

Fully  to  characterize  the  expected  performance  of  a  missile,  ail  possible  reliabilities  should  be: 

a.  Determined  and  weighted  in  accordance  with: 

(1)  Their  engineering  importance, 

(2)  Probability  of  occurrence  of  the  various  environments, 

(3)  Duration  and  intensity  of  the  environment, 

(4)  Presence  of  interaction  among  environments  and  among  components,  and 

b.  Mathematically  combined; 

( 1 )  In  accordance  with  the  way  the  environments  occur  (i.e.,  simultaneously,  in 
combination,  or  in  sequence), 

12)  In  various  ways  to  predict  the  probability  of  successful  functioning  of  the 
major  and  minor  subassemblies, 

(3)  In  accordance  with  the  system  circuitry  to  predict  the  reliabilities  of  the 

qver-all  system. 

C.  Cost 

The  cost  of  measuring  the  magnitude  and  interaction  effects  of  the  multitude  of  variables 
affecting  peHormance  of  cbmplex  missile  systems  is  prohibitive,  as  in  the  cost  of  determining 
all  of  an  item's  possible  reliability  values,  br  even  a  targe  number  of  these. values.  These  costs  will 
perhaps  remain  prohibitive  as  long  as  there  is  a  reasonable  alternative.  ’ 
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4. 


SAFETY  MARGINS 


The  use  of  safety  margins  to  assure  successful  functioning  under  unpredictable  conditions  is 
not  new.  Currently,  reliance  is  placed  on  the  "safety  factor"  or  the  "margin  of  safety"  as  an 
alternative  for  information.  If  the  expected  nominal  "stress"  (or  load)  in  use  is  100  units,  de¬ 
signing  an  item  with  the"strength"  to  withstand  several  times  this  "stress"  gives  intuitive  assurance 
that  the  item  will  function  successfully  without  failure  (i.e.,  be  reliable).  Such  an  item  will  surely 
withstand  100  units  of  "stress"  (be  highly  reliable  under  this  condition)  and  has  a  good  chance 
of  functioning  successfully  even  when  the  applied  "stress"  varies  widely,  the  quality  of  the  material 
is  substandard,  or  the  workmanship  is  poor.  A  large  margin  of  safety,  then,  is  a  means  of  assuring 
successful  functioning  in  the  presence  of  uncontrolled  and  indeterminate  variations  in  environ¬ 
ment,  materials,  and  workmanship.  This  concept  of  "stress"  and  "strength"  can  be  used  as  a 
corollary  to  the  definition  of  reliability  given  above:  An  item  cannot  fail  until  the  stress  exceeds 
its  strength.  The  point  at  which  the  stress  equals  the  strength  measures  the  average  (ultimate) 
strength.  At  this  point  the  reliability  equals  50  percent.  To  raise  the  reliability  above  this  level,  the 
strength  must  exceed  the  expected  in-use  stress.  High  strength  relative  to  the  stress  means  high 
reliability,  since  the  higher  the  strength,  the  less  likely  a  failure  is  to  occur. 

Construction  engineers  design  an  item  to  withrtand  several  times  the  load  expected  in  use 
(for  the  above  reasons),  then  evaluate  the  design  by  leasuring  the  safety  factor  of  a  few  representa¬ 
tive  specimens.  This  can  only  be  done  by  applying  a  load  until  the  specimens  break,  or  fail  in  some 
other  manner.  The  breaking  load  is  a  measure  of  the  ultimate  strength.  The  "safety  factor”  is  the 
ultimate  strength  divid&d  by  the  load  expected  in  use.  The  "margin  of  safety”  is  the  difference  be¬ 
tween  those  two  loads  divided  by  the  expected  load  in  use.  Calculating  either  of  these  values  is 
as  far  as  construction  engineers  usually  go;  they  do  not  calculate  a  numerical  value  for  the  probabi¬ 
lity  of  success  in  use  (reliability)  created  by  the  safetv  factor.  If  the  safety  factor  is  large,  they 
fee!  confident  in  concluding  (predicting)  the  item  w  i  not  fail  in  use. 

Missile  engineers  also  use  Mftty  margins.  They  design  margins  of  safety  into  missile  com¬ 
ponents  in  many  subtle  ways  and  for  the  same  reasons;  to  assure  successful  performance  in  use 
under  uncontrolled  and  unpredictable  conditions.  Here,  too,  the  "margin  of  safety"  designed 
into  an  item  can  only  be  determined  by  testing  to  failure,  The  "stress"  required  to  cause  failure 
can  also  be  termed  ultimate  "strength." 


ULTIMATE  RELIABILITY 


The  reliabiiity  obtained  by  testing  to  failure  is  the  ultimate  'maximum)  reliability,  whether 
a  margin  of  safety  is  used  or  not.  Ths  is  the  only  unbiased  measure  of  the  true  reliability  created 
by  the  design  of  the  item. 

Testing  without  failure  demonstrates  reiiability  only  in  proportion  to  the  number  of 
test  specimens  used.  This  is  a  biased  estimate  of  the  ultimate  reliability.  This  means  that  the 
ultimate  reiiability  cannot  be  determined  by  testing  a  finite  nun.ber  of  specimens  without  failure. 


6. 


PLANNED  EXPERIMENTS 


When  only  one  of  the  possible  total  number  of  reliabilities  can  be  determined,  the  logical 
choice  is  to  determine  the  minimum  reliability.  If  the  latter  is  satisfactory,  all  other  possible 
reliabilities  with  respect  to  separate  environments  will  also  be  satisfactory.  Without  a  knowledge 
of  the  values  of  all  reliabilities,  meaningful  and  realistic  system  reliabilities  can  only  be  predicted 
from  component  reliabilities  on  the  basis  of  the  minimum  reliabilities. 

Experiments  must  be  designed*.  This  requires  planning  in  advance  of  data  collection.  T^ 
plans  must  be  specifically  designed  to  assure,  in  advance  of  data  collection,  that  specified  objec¬ 
tives  will  be  attained,  for  reliability  can  neither  be  tested,  mr  analyzed  into  an  item. 

Environmental  conditions  which  cause  the  poorest  (minimum)  reliabilities  can  be  found 
most  efficiently  (with  smallest  sample  sizes)  by  means  of  fractional-factorial  designs  or  their  opti¬ 
mized  modifications.  The  object  here  is  to  survey  environments  considered  most  important  to 
the  functioning  of  the  item  and  to  find  the  environment  having  the  most  severe  effect  (i.e.,  causing 
the  lowest  reliability).  This  environment  is  then  used  to  determine  the  minimum  ultimate  reliabi¬ 
lity  by  testing  to  failure,  using  tests  of  increased  severity. 


7.  . 


TESTING  WITHOUT  PAILURE 


The  margin  of  safety  designed  into  a  missile  component  can  be  determined  only  by  testing 
to  failure.  To  do  otherwise,  practically  nullifies  the  value  of  test  results  and  makes  the  engineer's 
effort  to  use  safety  margins  ineffective.  If  the  test  procedure  does  not  measure  safety  margins, 
the  engineer  has  no  evidence  that  they  exist,  and  may  conclude  that  other  means  of  increasing 
reliability  (e.g.,  redundancy)  must  be  used.  This  line  of  action  is  not  only  costly,  bu  may  create 
other  problems,  such  as:  misplaced  center  of  gravity,  overweight,  and  lack  of  space. 


Testing  without  failure,  which  entails  large  sample  sizes,  is  costly.  By  this  method,  it  takes 
460  items  to  demonstrate  a  reliability  of  at  least  99.5  percent  with  90  percent  confidence.  The 
same  reliability  can  be  demonstrated  (if  it  exists  ih  the  item)  with  25-30  items  by  testing  to  fail¬ 
ure,  using  tests  of  increas^  severity,.  In  addition  the  results  of  testing  without  failure  causes 
difficulty  m  calculating  system  reliability  from  component  reliability  because  zeros  cannot  be 
mathematically  manipulated. 


dsui 


Because  testing  without  failure  cannot  me 
trends  cannot  be  detected  early  enough  for  takinb 
the  ultimate  reliability  of  an  item  actually  exceed 
(0.995  or  higher),  and  only  25  items  are  tested  at 
testing  period,  no  trend  will  be  detected  until  uitji 
below  0.91  (at  the  90  percent  confidence  level). 


re  ultimahi  reliability  with  »na)i  sample  sizes, 
timely  corective  action.  For  example,  if 
s  that  specified  in.  the  military  characteristics 
the  use  condition  widiout  failure  during  each 
mate  reliabiitty  of  the  lot,  or  stockpile,  drops 


See  Reference  12 


8.  RELATION  BETWEEN  TEST  AND  USE  CONDITIONS 


To  translate  the  reliability  demonstrated  under  test  conditions  to  a  "reliability-in-use" 
value,  the  relation  between  the  "use"  and  "test"  conditions  must  be  established.  Experience  has 
shown  that  this  relationship  can  be  adequately  represented  by  frequency  distributions.  This  places 
the  relationship  on  a  probabilistic  basis,  and  also  makes  possible  the  use  of  the  laws  of  probability. 
If  then,  the  test  results  are  properly  collected  (see  Lab  Test  Methods),  the  reliability-in-use  can  be 
calculated  by  extrapolation. 


9. 


TEST  PLANS 


Plans  should  be  made  to  conduct  experiments  in  two  stages: 

A.  Factorial  experiments: 

For  each  type  of  component,  the  separate  effects  of  the  critical  environments  can 
be  determined  most  efficiently  in  one  integrated  factorial  experiment.  From  these  results,  the 
environments  having  the  most  severe  effects  should  be  selected.  When  only  attribute  data  can  be 
obtained  the  optimum  condition  for  conducting  this  experiment  is  at  a  level  of  severity  at  which 
approximately  50  percent  of  the  test  specimens  can  be  expected  to  fail.  This  type  of  experiment 
is  highly  efficient.  The  effect  of  as  many  as  7  environments  can  be  determined  with  8  test  speci¬ 
mens,  or  the  effects  of  1 5  environments  with  16  test  specimens. 

B.  Testing  to  Failure 

Within  the  limitations  imposed  upon  the  experiment,  determine  the  reliability  with 
respect  to  as  many  as  possible  of  the  environments  having  the  most  severe  effects.  This  can  be 
accomplished  most  efficiently  using  a  test  of  increased  severity  such  as  the  Bruceton  up-and-down 
method.  It  is  only  with  this  type  of  test  that  the  ultimate  "strength"  can  be  determined  when  the 
occurrence  of  a  failure  cannot  be  detected  by  inspection  or  when  the  magnitude  of  the  stress  at 
the  point  of  failure  cannot  be  directly  observed.  From  this  information  the  predicted  ultimate 
"reliability-in-use"  can  be  calculated.  Ultimate  "reliability-in-use"  of  any  magnitude  that  exists 
in  an  item  can  be  demonstrated  with  as  few  as  25  to  30  test  specimens  by  testing  the  failure  with 
tests  of  increased  severity. 
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II 


MODERN  STATISTICAL  CONCEPTS 


1.  INTRODUCTION 


Because  of  the  nature  of  reliability  and  because  of  the  metf.ods  required  to  determine  reli¬ 
ability,  modern  statistical  concepts,  such  as  probability,  experimental  error,  population  —  sample 
relation,  frequency  distributions,  confidence  intervals,  sample  size,  and  design  of  experiment 
techniques  must  be  understood,  if  reliability  experiments  are  to  be  conducted  and  reliability  values 
calculated  and  interpreted.  It  is  only  with  these  concepts  that  the  vexing  problem  of  demonstrat¬ 
ing  high  reliabilities  with  small  sample  sizes  can  be  solved. 

Modern  statistical  methods  of  experimentation  contain  a  new  ingredient  not  explicit  in 
mathematics:  Error.  The  new  philosophy  assumes  that  there  is  an  error  in  every  measurement  made 
and  as  a  consequence,  the  true  values  of  measurable  characteristics  can  never  be  known  exactly. 

To  cope  with  this  deficiency  of  measuring  processes,  repeated  measurements  are  made.  Then  from 
this  data  an  interval  is  calculated  which  we  believe  includes  the  true  value  represented  by  the  data. 
Intervals  of  this  kind  are  called  confidence  intervals. 

Included  in  the  method  of  calculating  these  intervals  is  a  means  of  controlling  the  propor¬ 
tion  of  the  time  that  the  true  value  is  expected  to  fall  within  the  interval.  Thut:  the  name.  This 
proportion  expresses  our  "confidence"  of  being  right  in  our  prediction  that  the  true  value  will 
fall  m  the  interval  calculated.  Formulas  for  calculating  confidence  intervals  are  given  below  in 
Section  IX:  Reliability  Confidence  intervals. 


2. 


EXPERIMENTAL  ERRORS 


If  the  same  characteristic  is  repeatedly  measured  with  an  "accurate^'  device  under  constant 
conditions,  the  same  result  will  not  always  be  obtained.  Ai  a  matter  of  fact,  the  same  result  will 
seldom  be  repeated.  However,  it  will  be  noticed  that  most  of  the  values  will  clyster  rather  closely. 
Only  a  fevv  very  small  and  very  large  values  will  be  obtained.  It  is  assumed  that  these  observed 
deviations  are.  due  to  chance  errors  in  the  measuring  process.  They  are  called  experimental  errors. 


3. 


POPULATION  VS  SAMPLE 


The  family  of  values  generated  by  repeated  measui  is'nents  of  the  s«na  characteristic  is 
called  a  population:  A  population  is  generally  assumed  to  be  infinite.  Any  sub-p<Mtion  of  a  popu¬ 
lation  is  called  a  sample  of  that  population.  A  sample  iS  always  finite. 

4.  PREDICTION  ERRORS 

The  reasoning  behind  the  new  philosophy  is  as  follows:  The  observations  or  measurements 
made  in  any  experiment  are,  in  fact,  finite  samples  of  a  mudr  targer  (infinite)  body  of  data  that 


could  exist  had  thousands  (infinite)  of  observr.tions  been  made  of  the  same  characteristic  under 
the  same  constant  conditions,  it  is  assumed  that  unless  an  infinite  number  of  observations  is 
made,  the  true  value  of  the  characteristic  measured  will  never  be  exactly  known.  This  reasoning 
requires  focus  of  attention  not  on  the  observixl  values  but  on  what  these  values  represent  -  the 
larger  family  of  all  possible  values  of  the  characteristic  being  measure^  The  objective  is  to  infer 
from  the  sample  something  about  the  population.  Experience  has  ta  ght  that  prediction  (an  in¬ 
ference)  cannot  be  made  with  certaintv.  There  is  always  a  chance  ot  being  wrong.  Errors  of  this 
type  are  called  the  prediction  errors. 


5.  FREQUENCY  DISTRIBUTION 


if  all  measurements  referred  to  above  are  divided  into  small  groups  or  cells  having  a  range 
equai  to  about  one-tenth  the  total  range  (from  maximum  to  minimum)  of  all  values,  there  will 
be  about  ten  cells.  Then  if  a  count  is  taken  of  the  number  of  values  falling  within  the  range  of  a 
particular  cell,  the  ratio  of  this  number  to  the  total  number  of  measurements  available  is  the  rela¬ 
tive  frequency  of  occurrence  ot  measurements  (events)  in  that  cell.  If  the  total  number  of  meas¬ 
urements  available  is  very  large  (1 ,000  or  more)  and  all  values  falling  within  the  cell  are  counted, 
a  vf  ry  good  estimate  of  the  .true  frequency  of  occurrence  of  values  in  that  cell  for  that  particu¬ 
lar  population  will  result.  Doing  this  for  all  the  cells  would  give  values  that  could  be  piptted  on  a 
br.r  graph  as  follows:  Arrange  the  cells  along  the  abscissa  in  aacending  order  according  to  the 
magnitude  of  the  midpoints  of  their  range;  erect  bars  over  these  midpoints  with  height  propor¬ 
tional  to  the  relative  frequency  in  each  cell  and  widths  equal  to  the  cell  width.  This  bar  graph  is 
known  as  a  histogram. 


6.  NORMAL  DISTRIBUTION 


As  the  total  number  of  values  used  is  increased  and  the  cell  width  (range)  decreased,  the 
step-wise  form  of  the  bar  graph  fades  into  a  smooth  curve  that  is  called  a  frequency  distribution. 

In  practice,  this  is  actually  how  a  frequency  distribution  is  foimed.  It  means  what  the  name 
implies.  It  is  a  distribution  of  (relative)  frequencies. 

Experience  has  shown  that  the  famili<JS  of  valuw  generated  by  repeated  measurements  of 
the  same  characteristic  under  controlled  conditions  have  definite  forms.  The  most  common  of 
these  forms  and  the  most  useful  is  called  the  normal  frequency  distribution.  This  is  the  smooth 
curve  described  above.  It  is  bbllshaped.  The  family  of  values  forming  this  distribution  is  called  the 
normal  population. 

As  the  cell  width  in  the  bar  graph  decreases  and  approaches  zero,  the  height  of  the  bar  re¬ 
presents  the  relative  frequency  for  a  single  value  on  the  abscissa.  Thus  there  is  a  relath/e  frequency 
for  any  value  in  the  population  of  measurements.  The  sum  of  all  the  frequencies  equals  the  fre¬ 
quency  of  all  the  values  in  the  population  which  is  assigned  the  numertcal  value  of  one.  The  equa¬ 
tion  for  this  function  is  known,  but  it  is  of  no  direct  importance  for  the  purpose  of  ’his  discussion. 
It  can  be  found  in  any  standard  text  on  statistics. 
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7. 


PROBABILITY 


From  a  practical  point  of  view  relative  frequencies  (proportions)  are  estimates  of  probabili¬ 
ties.  By  definition,  if  it  is  certain  that  an  event  will  occur,  it  is  said  that  the  probability  of  occur¬ 
rence  is  equal  to  unity.  If  it  is  certain  that  an  event  will  not  occur,  it  is  said  that  the  probability  of 
occurrence  is  e<7jal  to  zero. 

In  the  above  example,  if  the  cell  width  was  equal  to  the  range  of  the  population  (from  the 
maximum  to  the  minimum  value  in  the  popuiaiion)  it  would  be  certain  that  the  next  value  taken 
would  fall  within  this  "cell.”  As  a  result  of  taking  repeated  measurements,  all  of  the  values  would 
fall  within  this  "cell."  The  number  of  values  falling  within  this  "cell"  divided  by  the  total  number 
of  values  will  equci  unity.  That  is,  the  probability  of  a  value's  falling  within  the  "cell"  (the  event) 
is  equal  to  one. 

If,  on  the  other  hand,  a  hew  ceil  is  taken  having  a  maximum  limit  less  than  the.minimum  of 
the  above  population,  it  is  certain  that  the  next  value  taken  from  the  above  population  will  not  fall 
within  the  new  cell.  If  repeated  measurements  are  taken  from  the  above  population,  none  of  the 
values  will  fall  within  the  new  cell.  The  number  of  values  falling  within  the  cell  divided  by  the  total 
number  of  values  will  equal  zero.  That  is,  the  probability  of  a  value's  falling  within  the  cell  (the 
event)  is  equal  to  zero. 

The  area  under  the  normal  frequency  distribution  is  used  to  measure  probabilities.  As  shown 
above,  the  magnitude  of  the  ordinate  associated  with  any  value  on  the  abscissa  is  a  measure  of  the 
relative  frequency  of  occurrence  (or  probability  of  occurrence)  of  that  value.  The  summation  of 
all  the  ordinates  below  any  particular  value  on  the  abscissa  is,  of  course,  equal  to  the  area  under  the 
curve  below  that  ordinate.  This  area  is  then  a  measure  of  the  probability  of  occurrence  of  all 
values  in  the  population  below  the  given  value. 


8.  PARAMETERS 


Just  two  parameters  or  characteristics  of  the  normal  frequency  distribution  are  required  to 
defipe  this  curve  completely.  The  first  parameter  is  the  central  value  aiourKl  which  most  of  the 
values  belonging  to  a  particular  population  will  naturally  cluster.  This  param<'.t.i  is  called, the  true 
or  population  mean  and  is  measured  by  the  arithmetic  average  of  a//  the  values  hi  the  population. 
The  other  parameter  required  is  the  dispersion  of  values  around  die  central  value.  This  parameter 
is  measured  by  the  root  mean  square  of  the  deviations  from  the  true  m^  and  is  called  the  true  or 
population  standard  deviation. 
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9. 


PROPERTIES  OF  NORMAL  CURVE 


Graphically,  the  mean  is  the  ordinate  that  passes  through  the  center  of  gravity  of  the  area 
under  the  curve,  since  this  curve  is  symmetrical.  The  mean  is  equal  to  the  mode  (the  most  fre¬ 
quently  occurring  value)  and  the  median  (the  middle  value). 

Also,  graphically,  the  standard  deviation  is  equal  to  the  horizontal  distance  between  the 
ordinate  of  the  mean  and  the  inflection  point  on  the  curve  on  either  side  of  the  mean  ordinate. 


The  Normal  Deviate: 

Z  =  (x  -  M)/a 

This  is  the  linear  measure 
of  distance  along  the  base 
of  the  curve  in  standard 
deviation  units. 


Where:  pi  *  The  true  population  mean. 

a  =  The  true  population  standard  deviation. 


X  =  Any  observed  value. 


The  true  mean  plus  or  minus  one  standard  deviation  includes  68.Z7  percent  of  the  total 
area  under  the  curve.  The  mean  plus  or  minus  two  standard  deviations  wilt  include  95.45  percent 
of  the'total  area  under  the  curve.  These  values  are  used  to  make  probability  statements.  They 
mean  either  of  both  of  the  following: 

A.  In  generating  a  normal  family  of  vaiucs,  68  percent  of  the  total  number  of  values  will  lie 
within  plus  or  minus  one  standard  deviation  of  the  mean.  This  is  especially  true  if  the  total  number 
is  very  large  —  i.e.,  I,d00  or  more. 

6.  Rar  domiy  chosen  values  from  the  normal  population  have  a  68  percent  chance  or  a 
probability  o' 0.63  of  falling  wi^in  plus  or  minus  one  standard  deviation  of  the  mean. 

This  distribution  is  unique  in  nature.  It  is  the  curve  of  regression  for  the  distribution  of  all 
smalt  ^ple  {averages. 


10. 


RAIMCOMIZATIOIM 


The  meaning  of  the  word  random  as  used  in  modern  statistics  can  be  better  described  than 
defined.  The  phrase  "randomly  chosen  values"  describes  a  selection  procedure  of  a  very  special 
kind.  T1  is  procedure  is  free  of  biases  of  all  sorts,  't  is  the  only  procedure  which  will  permit  the 
free  play  of  chance  variations,  which  are  the  theoretical  basis  for  all  modern  statistical  techniques. 

Random  selection  or  random  sampling  can  be  accomplished  by  physically  mixing  the  items 
before  sampling,  or  by  numbering  all  of  the  items  and  then  using  a  table' of  random  numbers  to 
determine  which  items  to  select  and  in  what  order  to  select  them.  Random  selection  is  the  pro¬ 
cess  used  in  loneries,  all  numbered  tickets  being  deposited  in  a  revolving  drum  and  a  single  drawing 
made  by  a  blindfolded  person.  It  is  assumed  that  such  a  procedure  is  completely  unbiased,  that 
chance  alone  is  at  play,  and  that  each  ticket  in  the  drum  has  an  equal  chance  of  being  selected. 

The  process  of  random  selection  then,  not  only  permits  the  laws  of  chance  to  determine  which 
item  is  to  be  chosen,  but  also  the  order  in  which  successive  items  are  chosen.  This  procedure  re¬ 
lieves  the  experimenter  completely  of  any  responsibility  concerning  "which  item"  anvi  "which 
order."  In  the  lottery,  the  operator  wants  to  be  "fair."  In  an  experiment,  the  experimenter  wants 
to  be  unbiased. 


11. 


SAMPLING 


In  a  lottery  the  rv!  nive  frequency  of  occurrence  of  any  particular  number  is  ^ual  to  the 
relative  frequency  of  occurrence  of  any  other  number  in  the  drum  (population).  Each  nurrbe;  bas 
an  equal  chance  of  being  selected  if  the  selection  procedure  is  truly  random  and  unbiased.  However, 
the  relative  frequency  of  occurrence  of  the  values  in  a  normal  population  is  not  equal.  Theoreti¬ 
cally,  all  are  different.  A  little  reflection  will  show,  however,  that  random  selection  will  be  "fair" 
and  unbiased  here,  also.  If  in  a  bowl,  900  white  beads  and  100  red  beads  a'%  mixed  well  (i.e., 
randomized),  and  a  handful  of  beads  selected  by  a  blindfolded  person,  the  ratio  of  red  to  white 
beads  in  that  or  any  other  handful  will  be  close  to  1  to  9.  The  average  ratio  of  a  large  number  of 
trials  (handfuls)  will  be  1  to  9  ~  the  relative  frequencies  of  the  two  colored  beads  in  the  bowl,  the 
population.  This  same  relation  between  sample  and  population  holds  true  in  selecting  (sampling) 
values  from  a  normal  distribution  if  sampling  is  done  in  a  random  fashion.  That  is,  every  value 
(or  item)  in  the  population  has  a  chance  (probability)  of  being  selected  equal  to  the  frequency 
with  which  it  actually  exists  in  the  population.  Only  samples  that  can  reflect  these  actual  relative 
frequencies  in  the  population  can  be  considered  as  representing  the  populatbii  in  an  unbiased 
manner.  Samples  must  correctly  represent  the  population  from  which  they  are  taken  if  valid  in¬ 
ferences  are  to  be  made  about  the  population,  from  the  sample.  Of  course,  successive  samples 
drawn  from  the  same  population  will  not  be  identical,  but  if  randomly  selected,  the  difference 
between  them  will  be  due  to  chance  errors  only.  Under  these  circumstance  modem  statistical 
technique  will  identify  them  as  having  come  from  the  same  population,  which,  in  fact,  diey  did. 


12. 


ESTIMATES 


In  practice,  to  make  a  measurement  (or  observation)  is  to  estknate  dte  true  poixilatlon 
mean.  The  more  observations  made  and  averaged  togethe,  the  better  the  estimate.  This  estimate 


is  called  a  "point  estimate"  to  distinguish  it  from  an  "interval  estimate."  However,  it  is  assumed 
that  the  true  mean  is  never  known  exactly  unless  an  infinite  number  of  observations  is  made. 

If  the  root  mean  square  of  the  deviations  of  the  individual  observations  is  calculated  from 
the  average  of  all  observations,  the  true  population  standard  deviation  can  be  estimated.  As  with 
the  mean,  however,  it  is  assumed  that  this  true  parameter  is  never  known  exactly  unless  an  infinite 
number  of  observations  is  made. 


13.  PREDICTIONS 


The  two  predictions  made  most  often  in  modern  statistics  are  the  following; 

A.  The  magnitude  of  the  true  parameters.  These  predictions  are  based  on  interval  estimates 
which  are  called  confidence  intervals. 

B.  Whether  two  or  more  values  belong  to  the  same  population.  These  predictions  are  called 
tests  of  significance. 

The  prediction  problem  in  modern  statistics  is  to  estimate  first  the  population  mean  and 
standard  deviation  and  then  predict  what  these  two  population  parameters  might  be  or,  given  two 
or  more  estimates,  to  predict  whether  they  came  from  the  same  population.  If  there  are  thousands 
of  observations  in  each  of  the  samples,  the  sample  means  and  rtjiioard  deviations  are,  for  all  practi¬ 
cal  purposes,  equal  to  the  population  parameters  and  prediction  becomes  unnecessary,  in  practice, 
however,  such  large  samples  are  generally  not  available.  They  are  too  costly  to  obtain.  The  prob¬ 
lem,  then,  is  to  predict  from  small  samples  what  the  parameters  might  be  or  whether  the  samples 
came  from  the  same  population. 

Intuitively,  it  is  known  that  predictions  cannot  be  made  with  certainty  —  there  is  always 
a  possibility  of  being  wrong.  As  a  result,  to  be  right  as  often  as  possible,  reliance  is  placed  on 
planning.  In  modern  statistics,.this  possibility  is  maximized,  and  chances  of  being  right  are  actually 
controlled. 

To  place  this  on  a  mathematical  basis  the  assumption  is  made  that  the  data  have  a  normal 
frequency  distribution.  The  normal  distribution  is  then  used  to  calculate  the  probability  of  being 
right  in  making  predictions.  This  is  called  the  confidence  level  of  predictions.  The  techniques  of 
modem  statistics  have  been  developed  to  nfake  predictions.  The  assumption  that  the  distribution 
is  normal  for  variable  (measured)  data  is  a  reasonable  one.  Experience  has  shown  that  the  numerical 
values  of  measurable  characteristics  of  products  manufactured  under  controlled  conditions  are 
normally  distributed  (Ref.  11).  In  addition,  the  central  limit  theorem  states  that  the  distribution 
of  averages  of  variable  data  is  normal.  So,  when  comparing  aver^es  or  calculating  confidence 
intervals  of  measured  data,  the  assumotion  of  normality  is  quite  valid.  This  is  true  of  attribute 
(counted)  data  only  where  they  are  t.vnsformed  to  variable  data  by  some  such  process  as  the 
arc-sine  transformatitxi. 
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REQUIREMENTS  FOR  A  GOOD  EXPERIMENT 


1-  PREDESIGN  PHASE 

A.  Common  Sense 

Experimental  plans  and  experimental  results  that  violate  common  sense  are  discarded, 
not  the  common  sense. 

B.  Past  Experience 

Use  all  available  knowledge  and  information  from  past  experience. 

C.  Choice  of  Variables 

Make  a  comprehensive  list  of  all  the  variables  (factors  or  environmental  treatments) 
whose  effects  on  the  components'  functioning  characteristics  are  of  interest  or  must  be  determined. 
This  should  include: 

a.  Factors  of  direct  interest. 

b.  Factors  which  may  help  show  how  the  main  factors  work. 

c.  Factors  required  to  determine  the  effect  of  experimental  technique.  In  addition 
to  choosing  the  variables  to  be  used,  their  order  of  use  must  also  be  established.  The  order  chosen 
should  be  the  one  most  likely  to  be  experienced  in  use  or  the  one  considered  most  severe.  The 
order  selected  must  be  held  constant  throughout  the  experiment. 

D.  Choice  of  Factor  Levels 

a.  Number  of  levels. 

The  number  of  levels  used  in  the  designs  described  in  tftts  manual  has  been  limited 
to  two.  These  designs  are  the  simplest  and  the  most  versatile  for  conducting  rrajiti-factor  experi* 
ments. 

b-  Position  of  levels 

In  using  only  two  levels  those  used  are  usually  the  extremes,  sudt  <n  the  presence 
and  absence  of  an  environmental  treatment  or  extremely  low  crid  high  temperatures.  The  choice 
of  levels  used  must  be  airived  at  through  the  use  of  good  judgement,  common  sense,  and  detailed 
knowledge  of  the  purpose  and  probable  outcome  of  the  investigation.  Factorial  experiments  are 
most  efficient  in  their  ability  to  detect  differences  among  environmental  effects  when  the  levels 
of  severity  used  are  such  that  approximately  50  percent  of  the  test  specimens  faH. 


E. 

Consider  the  entire  scope  of  the  oroblenu  Without  regard  to  cost,  time,  or  effort  con¬ 
sider  what  it  is  that  must  be  known  eventually.  If  this  turns  out  to  be  a  very  large  experiment, 
the  cost  of  which  is  prohibitive,  divide  the  whole  problem  into  rational  parts.  This  makes  possible 
a  systematically  planned  approach.  It  also  makes  it  possible  to  relate  your  test  plan  to  cost  and  the 
amount  of  information  required. 

F.  Possible  Outcomes 

Consider  all  possible  outcomes  and  their  physical  interpretation.  Results  that  have 
no  physical  interpretation  have  no  practical  value. 

G.  Choice  of  Criteria 

Choose  carefully  the  criteria  on  which  conclusions  will  be  based.  To  insist  that  a 
component  have  a  reliability  of  0.999  with  respect  to  temperature  shock  is  of  little  value  when  it 
has  a  reliability  of  only  0.80  with  respect  to  transportation  vibration. 

H.  Formulation  of  Hypothesis 


Develop  the  right  hypothesis  by  asking  the  right  questions  the  experimental  results 
are  expected  to  answer.  To  show  conclusively  that  component  A  has  a  much  higher  reliability  than 
component  B  has  solved  nothing  if  component  A  cannot  be  mass  produced. 

I.  Type  of  Measurement 

The  type  of  measurement  to  be  used  should  be  considered  for  the  sake  of  efficiency. 
Variable  type  data  can  vary  from  minus  infinity  to  plus  infinity  and  furnish  the  maximum  informa¬ 
tion  per  observation.  Attribute  data  are  "success"  "failure"  t/pe  data  and  furnish  the  least  informa- 
tioi.  per  observation.  From  this  it  is  clear  that  variable  type  data  should  be  used  wherever  possible 
in  factorial  experiments;  care  should  be  exercised,  however,  in  using  variable  data  to  determine 
reliability  (see  below). 

J.  Choice  of  Experimental  Units 

* . .  '  . . —  . . - . 

a.  Definition  of  Experimental  Unit 


An  experimental  unit  (test  specimen)  is  the  smallest  sub-division  of  the  experi¬ 
mental  material  that  can  receive  different  tteatmente. 

b.  Size  of  experimental  unit 

Sufficient  homogeneous  or  uniform  material  ^ould  be  available  to  conduct  a 
complete  set  of  treatment  combinations  (required  by  the  experimental  design)  during  a  single 
period  of  time  (such  as  a  day)  by  a  single  instrument  condition  (such  as  calibration)  and  by  a  single 
operator  or  group  of  operators.  Material  produced  during  a  particular  period  of  time  by  a  single 
process  and  by  a  single  manufacturer  can  be  considered  homogeneous. 


IS 


c.  Representative  nature  of  experimental  units 


The  experimental  units  used  should  not  differ  in  any  important  respect  from  the 
best  known  (parts)  design  to  which  the  conclusions  are  to  apply.  If  design  changes  are  made  on  the 
basis  of  experimental  results,  thfc  items  used  to  obtain  t’  .  results  are,  of  course,  not  representative 
of  the  modified  design. 

d.  Independence  of  Experimental  Unit 


Experimental  units  should  respond  independently  of  one  another.  Obtaining  a 
failure  on  one  should  not  affect  in^  of  the  others.  Using  a  separate  item  for  each  treatment  com¬ 
bination  will  usually  assure  independence. 

K.  Choice  of  Treatments 

Treatments  are  chosen  to  give  as  direct  an  indication  as  possible  of  the  functioning 
characteristics  of  the  components  and  to  include  as  many  as  possible  of  the  environmental  condi¬ 
tions  expected  in  i:se.  This  is  an  engineering  decision  that  must  be  based  on  good  judgement  and 
intimate  knowledge  of  the  purpose  of  the  experiment. 

L  Sequential  Approach 

The  first  experiment  may  have  to  be  considered  exploratory  in  nature.  One  or  more 
ideas  may  be  generated  during  the  first  experiment  concerning  parts  design  modifications  or  ques¬ 
tions  may  be  raised  from  the  results  of  the  first  experiment  concerning  the  exact  effect  of  the 
environmental  treatments.  In  either  case  additional  experimentation  would  be  required  to: 

a.  Confirm  the  validity  of  the  modified  parts  design. 

b.  Clarify  the  effects  of  the  environments  which  produced  the  questionable  results. 

c.  Include  other  treatments. 

Committing  oneself  to  a  large  experiment  at  the  beginning  of  a  nevy  investigation  may  not  be 
feasible.  Small  exploratory  experiments  may  indicate  a  much  more  promising  approach  in  a  short 
time  and  with  little  cost.  In  this  procedure  the-  results  of  the  first  experiment  are  obtained  and 
analyzed  before  the  next  experiment  is  designed. 

2.  DESIGN  PHASE 


A.  Choice  of  design 

The  factorial  design  and  its  modifications  described  in  thb  manual  meet  the  require* 
ments  of  environmental  testing  experiments  better  than  any  other  known  design.  The  advantages 
of  the  recommended  factorial  designs  for  environmental  testing  are  as  follows: 

a.  Simple  to  use  and  analyze. 

b.  No  control  groups  are  required. 


c.  The  two  levels  of  each  treatment  can  be  the  presence  and  absence  of  the  treat¬ 
ment,  if  desired.  Alternatively,  anv'  two  levels  of  the  treatments  can  be  used. 

d.  Each  treatment  effect  can  be  determined  independently  of  all  the  others. 
Unambiguous  conclusions  can  be  drawn  about  each  treatment's  effects. 

e.  Complex  experiments  involving  a  large  number  of  treatments  can  be  easily 

handled. 

f.  These  are  the  only  experimental  designs  with  which  the  relationships  among  treat¬ 
ments  can  be  rheasured.  These  designs  can  determine  whether  ths  effect  of  one  treatment  depends 
upon  any  of  the  others.  These  relationships  are  called  interactions. 

g.  The  probability  of  being  right  or  wrong  can  be  controlled. 

h.  When  the  number  of  treatments  used  becomes  large  (three  or  more),  only  a 
fraction  (1/2, 1/4,  1/8,  etc.)  of  the  total  number  of  combinations  of  treatments  and  levels  need  be 
used.  These  designs  are  called  fractional  factorials  and  optimum  multifactcrials. 

i.  A  type  of  statistical  analysis  can  be  used  that  distinguishes  between  variations 
due  to  chance  and  variations  having  assignable  causes. 

j.  More  information  can  be  obtained  from  a  given  number  of  test  specimens  than  any 
other  known  procedure. 

k.  The  effective  sample  size  is  increased  by  making  it  possible  to  use  each  obferva- 
tion  (or  measurement)  for  more  than  one  purpose.  In  fret,  each  treatment  effect  is  determined  as 
though  the  entire  experiment  is  conducted  to  determine  that  particular  treatment  effect  alone. 

As  a  result,  the  precision  with  which  each  treatment  effect  is  determined  can  be  based  on  the  total 
number  of  test  specimens  used  in  the  experiment. 

B.  Sample  Size 


In  any  experimental  situation  a  reasonable  balance  must  be  established  between  using 
too  few  test  specimens  thus  obtaining  poor  precision,  and  wasting  time  and  material  in  attaining 
unnecessarily  high  precision  by  using  too  many  test  specimens.  When  there  is  a  preassigned  number 
of  test  specimens  available,  the  question  is  whether  it  is  worthwhile  to  do  the  experiment  at  all. 

If  the  number  or  test  specimens  available  is  flexible  and  adequate,  the  number  required  for  a  given 
precision  or  reliability  can  be  calculated  in  advance.  The  minimum  number  of  test  specimens  re¬ 
quired  In  the  optimized  designs  is  only  one  more  than  the  total  number  of  treatments  used.  The 
more  versatile  factorial  designs  require  at  least  16  items  for  five  through  eight  treatments  and  at 
least  32  items  for  nine  through  thirteen  treatments.  With  twice  these  numbers  of  items,  the 
latter  designs  can  also  measure  interactions. 


C.  Orthogonality 


The  property  of  these  designs,  known  as  orthogcnaiity,  must  be  preserved  in  order 
to  simplify  the  analysis  and  interpretation  of  the  -esults.  This  can  be  done  by  keeping  the  number 
of  observations  per  treatment  combination  equal  and  constant  throughout  the  entire  design. 
Orthogonality  assures  that  all  the  environmental  effects  and  their  interrelationships  can  be  in¬ 
dependently  estimated  vithout  entanglement. 

D.  Confounding 

Confounding  is  the  converse  of  orthogonality.  It  means  confuting,  entangling,  or 
equating  two  dr  more  factors  or  treatments  so  that  their  separate  effects  cannot  be  determined. 
For  example,  little  carl  be  concluded  about  the  separate  effects  of  die  environmental  trratments 
if  all  of  the  treatments  are  applied  to  each  item.  If  a  failure  is  obtained  after  an  item  has  received 
two  or  more  treatments,  the  cause  of  the  failure  is  ambiguous;  it  could  be  the  result  of  any  of  tiie 
following: 

a.  The  last  treatment. 

b.  The  last  two  treatments. 

c.  All  of  the  treatments. 

d.  Any  of  the  other  possible  combinations. 

The  exact  cause  cannot  be  determined  because  the  treatments  are  confounded.  This,  type  of  con¬ 
founding  should  be  avoided.  . 

E.  Interactions 


Interaction  is  said  to  be  present  when  certain  particular  treatment  combinations  pro¬ 
duce  unusual  results.  This  is  the  non-additive  or  unpredictable  portion  of  the  experiment;  as  such, 
interaction  effects  are  considered  discoveries  by  the  U.S.  Patent  Office  3nd  as  such  are  the  only 
patentable  (xirtion  of  the  experiment.  When  appreciable  interaction  effects  are  present,  care  must 
be  taken  in  quoting  main  (average)  effects.  Any  statement  about  the  average  effect  of  a  treatment 
itijst  specify  the  level  of  the  interacting  treatment  associated  with  that  avera^. 

However,  determination  of  interaction  effects  may  be  the  most  important  information 
obtained  from  an  experiment.  It  can  explain  what  otherwise  appear  to  be  contradictions.  This  is 
the  extra  information  furnished  by  factorials  that  cannot  be  obtained  from  other  designs.  Plans 
should  be  made  to  use  factorials  that  can  measure  interaction  effects  if  there  is  a  possibility- that 
they  exist.  Higher  order  interactions  can  be  used  as  es :imates  of  the  error  term  when  ntultipie 
r^lieation  is  not  used. 


F.  Replication 

By  replication  is  meant  repetition.  One  complete  replication  consists  of  a  single 
observation  for  each  of  the  treatment  combinations  in  the  design.  If  the  observations  are  performed 
in  sets,  so  that  a  complete  replication  is  done  in  a  continuous  period  of  time  (such  as  a  day),  with 
a  single  measuring  system  (or  instrument),  by  a  single  operator,  the  difference  among  replications 
can  be  used  to  determine  whether  the  external  experimental  conditions  have  remained  under  con¬ 
trol.  Multiple  replications  are  also  used  for  the  following  purposes: 

a.  Increase  the  precision  with  which  treatment  effects  are  determined. 

b.  Furnish  an  independent  measure  of  the  error  term. 

c.  As  a  basis  for  calculating  the  failure  rate  observed  for  each  treatment  combination 
in  preparation  for  transforming  attribute  data  to  a  continuous  scale  in  analysis  of  variance  proce¬ 
dures. 

G.  Blocking 


In  general,  blocking  means  dividing  the  entire  design  into  orthogonal  sub-groups. 
This  reduces  the  number  of  observations  that  need  be  taken  in  one  continuous  period  of  time  and 
reduces  the  amount  of  homogenous  material  required  in  one  batch.  Differences  among  blocks  due 
to  uncontrolled  changes  with  time  and  due  to  changes  in  material  can  be  mathematically  subtract¬ 
ed  out  of  the  system.  That  is,  the  object  of  blocking  is  to  make  it  possible  to  conduct  the  experi¬ 
ment  in  reasonably  small  portions.  Plans  should  be  made  to  block  any  large  experiment  or  any 
experiment  expected  to  extend  over  a  long  period  of  time.  Taking  observations  in  complete  re¬ 
plication  sets  is  one  form  of  blocking. 

H.  Randomization 


Randomization  can  be  accomplished  by  means  of  a  table  of  random  numbers  or  by 
drawing  well  shuffled  numbered  cards  from  a  hat.  The  important  charact;eristic  of  randomization 
is  that  it  be  an  objective  impersonal  procedure.  Proper  randomization  is  determined  by  examining 
the  procedure  producing  it,  not  by  examining  the  results.  To  randomize  does  not  mean  to  arrange 
in  an  order  that  looks  haphazard.  The  object  of  randomization  is  to  permit  the  laws  of  chance 
(probability)  to  have  free  play.  Proper  randomization  is  the  most  important  requirement  for  a 
good  experiment  because  it: 

a.  Prevents  biased  results  of  all  kinds  due  to  such  things  as,  hum^n  prejudice,  weather 
cycles,  trends  in  time,  heterogeneity  of  experimental  material,  etc. 

b.  Removes  systematic  error. 

c.  Relieves  the  experiments  of  the  responsibilit\  of  choosing  which  item  to  test 

or  which  test  to  conduct.  Each  item  or  test  is  equally  likely  to  be  chosen.  In  this  sense  the  experi¬ 
ment  is  "fair”  and  unbiased. 

d.  Assures  the  validity  of  statistical  techniques,  such  as  the  analysis  of  variance  and 
associated  tests  of  significance  which  depend  for  their  validity  upon  the  laws  of  probability. 
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However,  the  use  of  randomization  can  be  abused.  Randomization  should  not  be  used  to  conceal 
large  variations.  This  drastically  reduces  the  sensitivity  of  the  experiment  to  detect  small  differ¬ 
ences.  All  variables  known  to  have,  or  suspected  of  having,  significant  effects  on  the  outcome  of 
an  experiment  must  be  either  controlled  or  designed  into  the  experiment.  The  use  of  randomiza¬ 
tion  should  be  considered  as  an  expression  of  ignorance  and  used  only  to  remove  the  effects  of 
small  variations  after  every  other  source  of  variation  has  been  included  in  the  design,  or  controlled. 
Only  the  use  of  good  engineering  judgment  and  a  knowledge  of  the  system  can  determine  how, 
when,  and  where  to  use  randomization. 


3. 


ANALYSIS  PHASE 


A.  Statistical  Significance 

The  word  significance  has  a  special  technical  meaning  in  statistics.  Its  meaning  must 
be  understood  in  order  statistically  to  analyze  and  interpret  experimental  results.  One  of  the  most 
important  contributions  of  statistics  is  that  it  has  established  a  means  of  distinguishing  between 
chance  variations  and  assignable  causes.  When  the  observed  differences  are  due  to  chance  varia¬ 
tions,  these  differences  are  said  to  be  non-significant.  This  means  that  the  observed  results  origi¬ 
nated  from  the  same  source  (population).  When  the  observed  differences  have  assignable  causes  they 
are  said  to  be  significantly  different.  This  means  that  the  observed  results  have  priginated  from  dif¬ 
ferent  sources  (populations).  In  a  well  planned  experiment  these  sources  can  be  icentified.  In  the 
case  of  a  non-significant  difference,  changing  the  treatment  from  its  lower  level  to  its  higher  level 
has  not  caused  a  detectable  difference.  In  the  case  of  a  significant  difference,  changing  the  treat¬ 
ment  from  its  lower  level  to  its  higher  level  has  caused  a  detectable  difference. 

B.  Interpretation 


In  a  good  experiment  each  treatment  effect  should  have  a  unique  interpretation.  If 
two  or  more  interpretations  are  possible,  additional  work  is  required  to  clarify  the  ambiguities. 

One  of  the  most  important  requirements  of  a  good  experimental  design  is  that  the  conclusions  be 
unambiguous.  Fortunately  the  factorial  designs  are  very  helpful  in  avoiding  ambiguity.  To  con¬ 
clude  that  an  effect  is  not  significant  is  not  the  same  as  saying, that  the  effect  does  not  exist.  We  > 
can  only  say  that  there  is  insufficient  data  to  detect  the  eff^  However,  if  the  conclusions  are  that 
the  effects  are  significant  (from  the  test  of  significance),  we  can  be  assured  that  the  effect  is  real  to 
the  extent  of  the  confidence  level  associated  with  the  test  of  significance.  Further  advantages  of 
factorial  designs  are  as  follows: 

.  a.  The  range  of  validity  of  the  conclusions  concemirrg  the  average  (main)  effects  is 
extended  by  the  inclusion  of  more  than  one  variable  in  the  experiment. 

b.  Physical  interpretation  of  interactions  explain  and  clarify  underlying  mechanisms 
»id  relationdtips. 

C.  Qualitative  Data  (Success  or  Failure) 

When  only  one  observation  is  taken  for  each  deahnant  combination,  analysis  of  the 
results  from  the  factorial  designs  described  in  this  manual  is  made  very  simple  by  using  the  tables 


20 


of  minimum  contrasts  in  Appendix  3A.  These  tables  are  based  on  the  binomial  distribution.  The 
test  of  significance  that  uses  the  values  in  these  tables  is  known  as  Fisher's  Exact  Method  for  2x2 
Contingency  Tables.  This  test  is  valid  even  for  small  sample  sizes  and  will  determine  not  only  the 
main  effects  but  also  the  two-factor  interaction  effects  when  the  proper  designs  are  used  (see 
example  described  below).  When  multiple  (but  equal  number  of)  observations  are  taken  for  each 
treatment  combination,  the  Fisher  method  can  still  be  used.  However,  an  alternate  method  which  is 
slightly  more  efficient,  but  which  requires  more  calculating  can  also  be  used.  This  method  trans¬ 
forms  the  qualitative  data  to  a  continuous  scale  through  the  use  of  the  arc  sine  of  the  proportion , 
or  percentage  of  failures  found  for  each  treatment  combination.  The  transformed  data  can  be 
analyzed  by  the  usual  analysis  of  variance  techniques.  The  tests  of  significance  and  their  interpre¬ 
tations  are  both  made  using  the  transformed  data.  If  the  arc  sine  transformation  is  considered 
desirable,  it  is  suggested  that  a  statistician  be  consulted  to  conduct  the  analysis  of  variance. 

D.  Quantitative  Data 


For  quantitative  data  (such  as  g  -  values,  voltages,  or  time)  the  usual  analysis  of 
variance  can  be  conducted  on  the  observed  data  provided  the  variances  are  homogeneous  through¬ 
out  the  design.  Since  this  procedure  is  somewhat  involved,  lengthy  to  describe,  and  is  adequately 
covered  in  the  literature  (see  ref.  18  and  IS),  an  attempt  will  not  be  made  to  include  the  analysis 
of  variance  techniques  in  this  manual.  It  is  suggested  that  a  statistician  be  consulted  for  this 
analysis. 


IV 


PLANNING  TEST  PROGRAMS^- 


STATEMENT  OF  THE  PROBLEM 


A.  Identify  the  new  and  important  problem  area. 

B.  Outline  the  specific  problem  within  current  limitations. 

C.  Define  exact  scope  of  the  test  program. 

D.  Determine  relationship  of  the  particular  problem  to  the  whole  research  or  develop¬ 
ment  program. 


2.  BACKGROUND  INFORMATION 

A.  Investigate  all  available  sources  of  information. 

B.  Tabulate  data  pertinent  to  planning  new  program. 


3.  METHODS  DEVELOPMENT 

A.  Hold  a  conference  of  all  parties  concerned. 

a.  State  the  propositions  to  be  proved. 

b.  Agree  on  magnitude  of  differences  considered  worthwhile. 

c.  Outline  the  possible  alternative  outcomes. 

d.  Choose  the  factors  to  be  studied. 

e.  Determine  the  practical  range  of  these  factors  and  the  specific  levels  at  which 
tests  will  be  made. 

f .  Choose  the  end  measurements  which  are  to  be  made. 

g.  Consider  the  effect  of  sampling  variability  and  of  precision  of  test  methods. 

h.  Consider  possible  inter-relationships  (or  "interactions")  of  the  factors. 

i.  Determine  limitations  of  time,  cost,  materials,  manpovmr,  instrumentation  and 
other  facilities  and  of  extraneous  conditions,  such  as  weather. 

j.  Consider  human  relations  angles  of  the  program. 


-^This  outline  was  received  in  a  private  communication  from  Mr,  Charles  BIcking,  Office,  Chief  of 
Ordnance. 


4. 


DESIGN  OF  EXPERIMENT 


A.  Design  the  program  in  pre'iminary  form. 

a.  Prepare  a  systematic  and  inclusive  schedule. 

b.  Provide  for  step-wise  performance  or  adaptation  of  schedule  if  necessary. 

c.  Eliminate  effect  of  variables  not  under  study  by  controlling,  balancing,  or 
randomizing  them. 

d.  Minimize  the  number  of  experimental  runs. 

e.  Choose  the  method  of  statistical  analysis. 

f.  Arrange  for  orderly  accumulation  of  data. 

B.  Review  the  design  with  all  concerned. 

a.  Adjust  the  program  in  line  with  comments. 

b.  Spell  out  the  steps  to  be  followed  in  unmistakable  terms. 

5.  DATA  COLLECTION 

A.  Develop  methods,  materials,  and  equipment. 

B.  Apply  the  methods  or  techniques. 

C.  Attend  to  and  check  details;  modify  methods  if  necessary. 

0.  Record  any  modifications  of  program  design. 

E.  Take  precautions  in  collection  of  data. 

F.  Record  progress  of  the  program. 

6.  ANALYSIS  OF  DATA 

A.  Reduce  recorded  data,  |f  necessary,  to  numerical  form.  . 

B.  Apply  proper  mathematical  statistical  techniques. 

7.  INTERPRETATION  OF  RESULTS 

A.  Consider  all  the  observed  data, 

B.  Confine  conclusions  to  strict  deductions  from  the  evidence  at  h^. 


23 


C.  Test  quesstions  suggested  by  the  data  by  independent  experiments. 

D.  Arrive  at  conclusions  as  to  the  technical  meaning  of  results  as  well  as  their  statisti¬ 
cal  significance. 

E.  Point  out  implications  of  the  findings  for  application  and  for  further  work. 

F.  Account  for  any  limitations  imposed  by  the  methods  used. 

G.  State  results  in  terms  of  verifiable  probabilities. 
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V. 


COMPONENT  RELIABILITY 


1.  INTRODUCTION 


Reliability  is  the  probability  of  the  successful  performance  of  a  specified  characteris¬ 
tic: 

A.  Under  a  specified  condition  or  set  of  conditions, 

B.  For  a  specified  length  of  time, 

C.  After  a  specified  period  of  storage. 

The  "length  of  time"  requirement  can  usually  be  included  as  part  of  the  specified 
conditions. 

The  storage  requirement  has  to  do  with  age  or  storage  life.  This  requirement  involves 
the  use  of  iife-testing  techniques.  To  be  useful  these  techniques  must  be  able  to  predict  storage 
life  from  short-term  (a  few  days  or  weeks)  accelerated  laboratory  tests.  In  order  for  these  pre¬ 
dictions  to  be  valid,  the  laboratory  test  results  must  be  correlated  with  storage  life  results  by  actual 
long-term  storage  tests.  At  present  this  kind  of  information  is  not  available. 

Life-testing  techniques  can  also  be  used  to  determine  the  reliability  of  an  item  with 
respect  to  environments  whose  levjl  of  severity  can  only  be  increased  by  increasing  the  length  of 
time  of  exposure.  To  do  this,  however,  requires  the  establishment  of  a  minimum  length  of  ex¬ 
posure  time  for  successful  functioning.  The  difficulty  here  is  that  component  reliabiiities  estab¬ 
lished  by  tests  of  increased  severity,  in  which  time  is  the  variable,  are  not  comparable  with  com¬ 
ponent  reliabilities  established  by  tests  of  increased  severity  in  which  the  level  of  the  environment 
is  thevariable. 

These  two  kinds  of  component  reliability  cannot  both  be  used  in  the  same  system  to 
calculate  the  reliability  of  that  system  and  have  the  result  meaningful. 

The  Ideal  Test  Condition  i 

The  ideal  condition  for  determining  reliability  is  that  condition  found,  in  tensile  or  Icom- 
pression  terting.  That  is,  the  following  conditions  exist  which  make  possible  the  most  efficie  nt 
determination  of  the  ultimate  strength: 

1 .  The  observed  results  are  in  the  form  of  variable-type  data. 

2.  The  severity  of  the  applied  stress  can  be  easily  increased  until  failure  occurs. 

3.  The  magnitude  of  the  applied  stress  is  continuously  available  so  that  the  load  a  t  the 
point  of  failure  can  be  directly  observed. 

4.  The  occurrence  of  failure  can  be  detected  by  inspection. 

5.  The  average  of  the  observed  results  is  an  unbiased  estimate  of  the  ultimate  strer  gth. 

With  this  combination  of  conditions  and  information  the  greatest  precision  and 
accuracy  can  be  obtained  with  the  smallest  sample  size.  Aside  from  being  convenient  and  ea:  y 
to  conduct,  this  method  gives  a  direct  measure  of  the  ultimate  strength  and  therefore  the  nta  'gin 
of  safety  from  which  reliability-in-use  can  be  calculated. 
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The  efficiency  of  variable-type  data  can  be  fully  exploited  here  since  each  observed 
value  is  at  the  point  of  failure.  This  is  the  value  of  the  stress  that  the  50%  point  on  the  cumula¬ 
tive  frequency  curve  estimates  in  the  indirect  methods  described  in  Section  XI  3:  Tests  of  In¬ 
creased  Severity.  This  average  value  at  the  point  of  failure  in  the  ideal  test  and  the  50%  point 
in  the  indirect  methods  is  important  since  it  is  the  only  unbiased  measure  of  the  ultimate 
strength,  the  margin  of  safety,  and  the  reliability-in-use. 

In  all  reliability  testing  the  characteristics  of  the  ideal  testing  condition  should  be  kept 
in  mind  as  a  guide  in  more  complicated  situations  where  indirect  methods  must  be  used.  In  this 
way  the  disadvantages  of  testing  without  failure  and  collecting  variable-type  data  at  a  single  stress 
level  can  be  seen  in  better  perspective.  For  example,  measuring  the  resistance  of  the  circuits  of 
several  similar  test  specimens  at  a  single  voltage  cannot  measure  reliability.  This  procedure  gives 
only  one  point  on  the  ( 1^  R)-strength  curve.  Where  the  point  at  which  50%  of  the  items  fail  or 
what  the  margin  of  safety  is  cannot  be  determined  using  a  single  voltage  value.  Calculating  the 
probability  of  obtaining  resistance  values  outside  given  limits  with  infonnation  of  this  kind  as¬ 
sumes  that  the  margin  of  safety  is  equal  to  zero. 

2.  COMPONENT  TESTING 

Component  testing  can  be  accomplished  in  either  of  two  ways,  controlled  laboratory 
tests,  or  flight  tests.  Each  of  these  has  its  advantages  and  disadvantages: 

A.  Advantages  of  controlled  laboratory  testing  are: 

a.  Cost  T  This  is  the  cheapest  method  both  from  the  cost  of  test  facilities  and  from 
the  cost  of  test  specimens  for  determining  reliability  with  respect  to  separate  environments  during 
the  development  phase. 

b.  Information.  —  Co.mplete  information  can  be  obtained  since  the  test  specimens  are 
available  for  complete  instrumentation  and  visual  examination. 

c.  Controlled  conditions  —  Each  test  specimen  can  be  subjected  to  precisely  the  de¬ 
sired  treatment. 

d.  Results  —  Unbiased  estimates  of  reliability  can  be  obtained  by  testing  to  failure  in 
a  predetermined  manner  so  that  the  average  reliability-in-use  can  be  predicted  from  the  test  re¬ 
sults. 

e.  Efficiency  —  Tests  of  increased  severity  can  be  used  to  demonstrate  high  reliability 
with  small  sample  sizes. 

f.  System  reliability  prediction  ^  Information  can  be  furnished  on  a  current  ba$i$ 
during  the  development  phase  of  an  item  which  can  be  used  as  a  guide  during  development  and 
which  can  be  used  to  predict  the  expected  system  reliability. 

B.  Disadvantages  of  controlled  laboratory  testing  are: 

a.  Facility  limitations  -  Environments  must  be  applied  in  sequerKe  instead  of 
simultaneously  as  experienced  in  used. 
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b.  System  reliability  prediction  -  System  reliabilities  are  predicted  with  incom¬ 
plete  information.  The  extent  of  component  interaction  and  independence  is  not  known.  The 
degree  to  which  the  human  factor,  during  assembly,  reduces  reliability  is  also  not  known. 

c.  Sample  size  -  Larger  sample  sizes  are  required  for  laboratory  testing  of  com¬ 
ponents  under  use  -  conditions  than  for  testing  systems  in  flight  to  demonstrate  a  given  systems 
reliability. 

C.  Advantages  of  flight  tests  are: 

a.  Environment  —  Test  specimens  are  subjected  to  actual  use  conditions;  all  of  the. 
environments  are  applied  simultaneously  and  at  the  correct  level  of  intensity  and  duration. 

b.  Verification  -  Flight  testing  is  a  means  of  verifying  all  of  the  predictions  based 
on  component  values  and  other  information. 

D.  Disadvantages  of  flight  tests  are: 

a.  Observation  -  The  tested  specimens  are  not  available  for  examination. 

b.  Measuring  system  -  Measurement  by  telemetry  is  not  precise  or  reliable. 

c.  Cost  -  The  cost  of  flying  a  test  vehicle  is  excessive. 

d.  Storage  characteristics  -  Storage  characteristics  cannot  be  determined  by  flight 

tests.  ' 

E.  From  the  above  description  of  the  relative  merits  of  laboratory  testing  and  flight 
testing  the  following  conclusions  can  be  drawn: 

a.  Laboratory  testing  furnishes  the  most  information. 

b.  Efforts  to  improve  testing  methods  should  be  directed  to  improving  laboratory 

methods. 


Where: 

R  *  Mean  reliability  over  the  range  of  in-use  conditions 

P  =  Probability  of  failure-in-use  measured  by  the  overlapping  areas  under  the  stress  and 
strength  curves  (see  page  112  for  curves)  and  which  can  be  found  by  entering  a  table  of  areas 
under  the  standard  normal  curve  {Appendix  3G)  with  the  following  normal  deviate: 


A  failure  can  occur  only  when: 

Xi>X2 

Therefore  the  normal  deviate  becomes: 

M2-M1 

=  any  stress  value 
X2  =  any  strength  value 

Ml  =  True  (but  unknown)  mean  of  the  stress  distribution 

M2  =  True  (but  unknown)  mean  of  the  strength  (failure)  distribution 

o  ^  =  True  (but  unknown)  variance  of  the  stress  distribution 

a  True  (but  unknown)  variance  of  the  strength  (failure)  distribution, 
o 


The  above  values  can  be  estimated  from  sample  results  as  follows: 


A  A 

R  =  1-P 


Where: 

R  =  An  estimate  of  the  true  reliability  (R) 

"P*  =  An  estimate  of  the  trlie  probability  (P)  of  failure-in-use  which  can  be  found  by 
entering  a  table  of  areas  under  the  standard  normal  curve  (appendix  3G)  with  the  following 
calculated  value: 

T  2  1^2  '  1 

Where: 

T  =  The  normal  deviate  listed  in  appendix  3G  for  each  P  value. 

TT]  *  Average  in-use  condition  (in  terms  of  the  environmental  stress  level)  established 
by  experience  or  actual  measurement  of  the  handling,  storage,  or  flight  conditions. 
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X2  =  Averaqe  stress  at  the  observed  point  of  failure,  or  the  stress  at  the  point  50- 
percent  point  on  the  failure  rate  curve  established  by  a  test  of  increased  failure  when  the 
occurrence  of  a  failure  cannot  be  determined  by  inspection. 

I  X'j  -  X2I  =  Absolute  difference  between  the  two  averages  without  regard  to  the 
algebraic  sign,  which  is  a  measure  of  the  margin  of  safety. 

51  =  Standard  deviation  of  the  in-use  conditions  (in  terms  of  the  environmental 
stress  level)  established  by  a'^tual  measurement  of  handling,  storage,  and  flight  conditions. 

52  =  Standard  deviation  of  the  stress  at  the  observed  point  of  failure  or  standard 
deviatic  ‘  of  the  failure  rate  curve  (in  rerms  of  the  environmental  stress  level)  established  by  a 
Bruceton-type  test  of  increased  severity  when  the  environmental  stress  levels  at  the  point  of  failure 
cannot  be  observed  directly. 

B.  Life  tests.  When  time  is  the  variable  rather  than  the  level  of  the  environment  and 
the  length  of  time  (tj)  is  observed" for  each  failure  and  the  test  terminate  at  the  exact  time  (tg) 
of  the  last  failure; 


Where: 

^  =  Sample  reliability  under  the  test  condition  as  the  probability  of  no  failures 
.  in  time  (t). 

e  =  2.7183 

m  =  ti  +  t2  +  ---  +  t^^-(n-a)  tg  =  pg^  fgjiurg 

a  a 

tj  =  Time  to  failure  of  individual  components, 
h  *  Time  during  which  "a"  failures  occurred, 
a  »  Number  of  components  that  failed  in  time  (h) , 
n  =  Number  of  components  tested, 
t  *  Required  failure-free  time. 

This  formyla  is  not  applicable  during  infant  mortality  or  wear-out  periotis. 

C.  Binomial-type  data  (binomial  distribution).  The  following  technique  Is  applicable 
when  these  conditions  pertain: 

a.  The  lot  or  population  represent^  by  the  sample  is  very  large  or  ihfinite. 

b.  The  sample  size  is  less  than  10  percent  of  the  lot,  size. 
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c.  Each  test  specimen  can  fail  in  only  on6  way. 


n 


Where: 

A 

R  =  Sample  reliability.  The  probability  of  success  under  the  test  condition. 

k  =  Number  of  successes. 

n  =  Number  of  test  specimens  or  number  of  trials. 

D.  Variable-type  data.  By  definition  reliability  is  the  probability  that  an  item  will  per¬ 
form  successfully  under  a  specified  set  of  conditions  which  can  include  environments,  or  time,  or 
both.  If  it  does  not  perfot  m  successfully,  the  item  fails.  By  definition  there  are  only  two  possible 
outcofhes;  success  or  failure.  There  are  no  other  alternatives  in  reliability  testing.*  Half  of  the 
test  specimens  used  can  perform  successfully,  but  any  particular  specimen  cannot  "only  half  suc¬ 
ceed'  or  "succeed  half  way."  Just  as  when  tossing  coins,  heads  can  occur  on  half  of  the  coins, 
but  on  any  one  coin  there  cannot  be  a  "half  of  a  head." 

By  definition  then,  there  are  only  two  possible  outcomes  in  reliability  testing.  Data  of 
this  type  —  called  attribute  data  —  have  only  discrete  values  —  are  obtained  by  a  cou.iting  process. 

Variable  data,  as  the  name  implies,  can  vary  on  a  continuous  scale-from  zero  to  infinity. 
This  type  of  data  is  obtained  by  a  measuring  process. 

Text  books  on  the  subject  of  statistics  state  that  variable  data  are  more  efficient  than 
attribute  data  because  more  information  is  obtained  per  observation.  But  this  advantage  of  vari¬ 
able  data  does  not  pertain  to  reliability  testing  except  in  the  direct  method  where  the  observed 
values  estimate  the  ultimate  strength.  If  variable  data  be  used  for  reliability  testing  in  other  cases, 
they  can  only  be  for  the  purpose  of  measuring  a  characteristic  of  the  test  specimen  to  determine 
the  number  of  successes  or  failures.  In  this  application,  the  "text  book"  efficiency  of  variable 
data  is  lost  —  the  results  obtained  in  this  manner  can  be  used  in  the  formulas  given  above  for  cal¬ 
culating  reliability. 

The  probability  of  a  measured  value's  exceeding  a  given  limit  obtained  from  the  average 
and  standard  deviation  of  a  deperident  variable  (such  as,  ohm^  resistance,  percept  elongation, 
timing  accuracy  or  hardness)  at  ambient  static  conditions  does  not  measure  reliability.  There  can. 
never  be  a  reliability  with  respect  to  a  dependent  variable.  Dependmt  variables  are  properties  of 
an  item  or  material  the  same  as  reliability  is  a  property. 


*  Reliability  testing  means  the  stressing  of  a  test  specimen  by  an  environment  or  time,  to  measure 
the  margin  of  safety. 


30 


An  item  or  material  cannot  be  stressed  by,  or  suojected  to,  iis  own  properties.  In  failure 
testing  an  item's  properties  can  be  used  to  determine  only  the  number  of  successes  or  failures  when 
the  item  or  material  is  being  stressed  by  or  subjected  to  an  independent  variable  such  as,  F  M.F. 
in  volts,  tensile  load  in  pounds,  or  vibration  in  g's.  In  cases  of  this  kind  the  observed  proportion  of 
successes  measures  the  reliability  with  respect  to  the  independent  v:.riable.  ~ha  average  and  standard 
deviation  of  dependent  variables  at  ambient  static  conditions  can  measure  only  the  quality  of 
material,  the  quality  of  the  manufacturing  process,  or  the  effect  of  handling  or  storage  on  the  measured 
properites  —  not  reliability.  Although  there  can  be  reliability  with  respect  to  storage  conditions, 
this  reliability  must  be  measured  using  t:me  as  one  of  the  independent  variables  in  distributions 
such  as  the  Poisson.  Reliabilities  of  th's  kind  are  stated  in  terms  of  the  probability  of  no  failures 
in  a  given  length  of  time,  not  as  the  probability  of  a  valua  exceeding  a  given  limit. 
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VI 


SYSTEMS  RELIABILITY 


INTRODUCTION 


The  advantages  and  disadvantages  of  laboratory  and  flight  tests  described  above  for  com¬ 
ponents  also  pertain  to  testing  complete  systems;  however,  testing  complete  systems  cannot  be  used 
as  a  prediction  procedure  during  R  and  D  since  it  is  testing  after  the  fact.  In  addition  testing  com¬ 
plete  systems  is  expensive  and  difficult  even  in  the  laboratory.  As  a  result,  it  is  concluded  that  com¬ 
ponent  testing  must  be  done  during  the  development  phase  in  order  to  obtain  the  required  detailed 
information  when  it  is  needed.  In  so  doing,  all  of  the  shortcomings  of  the  several  methods  of  reli¬ 
ability  testing  which  constitute  the  state  of  the  ar ,  culminate  in  the  estimate  of  system  reliability. 
Some  of  the  errors  are  compensatory,  as: 

A.  Errors  that  underestimate  reliability. 


a.  Testing  without  failure. 

b.  Estimating  reliability  under  extreme  use  conditions  only. 

B.  Errors  that  overestimate  r  liability. 

a.  ,  Applying  environments  in  sequence  instead  of  simultaneously. 

b.  Estimating  reliability  with  respect  to  only  one  environment. 


c.  Calculating  system  relabilities  on  the  assumption  that  components  function  and 
react  to  environments  independently. 

To  what  extent  these  errors  compensate  one  another  is  not  known 

The  one  big  advantage  of  testing  comple  te  systems  under  use  conditions  after  the  R  and  D 


phase,  such  as  flight  tests  during  stockpile  testing. 


in  series  systems  with  a  given  sample  size.  For  example,  if  15  adaption  kits  are  flight  t''ited  without 
a  failure,  this  demonstrates  a  system  reliability  of  k  least  85  percent  at  the  90  percent  (one-sided) 
confidence  level.  On  the  assumption  that  the  adaption  kit  is  made  up  of  5  major  components  in 
series,  it  would  be  necessary  that  70  of  rach  of  th^  5  major  components  be  tested  without  a  failure 
to  demonstrate  an  equivalent  system  reliability  cajculated  from  the  components.  In  addition  the 
difficulty  of  how  to  apply  the  environments  to  th^  components  in  the  laboratory  would  be  en¬ 
countered. 


is  the  higher  reliabiiitv  that  can  be  demonstrated 


2. 


CALCULATION 


Obtaining  point  estimates  of  system  reliabilities  from  component  reliabilities  requires  the 
development  of  a  probability  equation  based  on  the  circuitry  of  the  system  and  the  laws  of  probabi 
lity.  Since  this  procedure  is  treated  extensively  in  readily  available  literature,  such  as  reference  15, 
it  has  not  been  inc  ;  Jed  here. 

When  each  test  specimen  (such  as  a  system)  can  fail  in  more  than  one  way,  the  Poisson 
distribution  can  be  used  as  follows  (ref.  14): 

R  =  e‘^ 

Where: 

A 

R  =  Sample  reliability  under  the  test  condition  as  the  probability  of  no  failures, 
e  =  2.7183 

X  =  a/n  the  average  number  of  failures, 
a  =  Number  of  failures, 
n  =  Number  of  test  specimens. 


3.  SAFETY 


Safety  can  be  defined  as  the  probability  of  a  catastrophic  failure.  A  measure  of  this  char¬ 
acteristic  can  be  obtained  from  the  techniques  described  herein  for  reliability,  with  slight  modifica¬ 
tion.  For  the  determination  of  safety,  only  catastrophic  failures  can  be  counted  and  used.  In  this 
case,  of  course,  the  objective  is  to  calculate  the  probability  of  a  failure-in-use  —  not  its  comple¬ 
ment. 

The  relation  between  safety  and  reliability  can  best  be  seen  from  the  following  diagram; 


PROBABILITIES 


Safe 


Unsafe 


»  1 


\ 

gOOI^-tDUD  -t- PREMATURE  4-  LATE  »  1 


Reliable  +  Unreliable 


«  1 
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VII 


RELIABILITY  CONFIDENCE  INTERVALS 


1.  Introductir  i 

A.  Definition 

A  confidence  interval  is  a  range  of  values  within  which  the  true  population  parameter- 
such  as  reliability-is  expected  to  lie.  The  confidence  level  associated  with  this  interval  is  a  prob¬ 
ability  statement  expressing  the  proportion  of  the  time  the  true  value  is  expected  to  be  within  the 
interval  or,  is  the  probability  of  being  right  in  predicting  that  the  true  value  will  be  within  the 
calculated  interval. 

B.  Best  Estimate 

In  order  to  calculate  a  valid  confidence  interval  the  "best  point  estitriate*'  of  the  true 
population  parameter  must  first  be  obtained.  Whether  an  estimator  is  the  "best"  depends  on  how 
it  is  determined  and  how  it  is  used.  On  the  assumption  that  the  estimator  used  is  the  correct  one 
for  the  intended  purpose,  it  is  considered  an  unbiased  point  estimate  if  the  mean  of  all  the  possible 
sample  values  equals  the  true  population  parameter.  This  also  means  that  the  estimator  is  accurate. 
In  addition  to  being  unbiased  the  estimator  used  should  also  be  efficient.  That  is,  the  unbiased 
estimator  chosen  for  use  should  have  the  minimum  variance  of  all  the  possible  unbiased  estimators 
that  -ould  be  used.  This  means  that  the  estimator  should  be  precise.  An  estimator  that  is  both 
unbiased  (accurate)  and  efficient  (precise)  is  said  to  give  the  "best  estimate"  of  the  true  population 
parameter.  It  is  this  kind  of  estimator  that  is  required  to  calculate  valid  confidence  intervals  or 
confidence  limits. 

In  most  engineering  work  the  arithmetic  average  of  variable  data  is  the  "best  estimate" 
of  the  true  mean  of  the  population  represented  by  the  data.  That  is,  the  arithmetic  mean  meets 
the  requirements  of  a  "best  estimate"  since: 

( 1 )  The  mean  of  all  the  possible  sarhple  (arithmetic)  averages  equals  the  true  mean  and  is 
therefore  unbiased. 

(2)  The  variance  of  the  arithmetic  mean  is  small^  than  those  of  other  possible  estimators, 
such  as  the  median,  mode,  or  mid-range. 

What  has  been  said  above  for  variable  data  is  also  true  for  attribute  data.  This  means  that 
in  both  cases  the  "best  estimate"  of  the  true  population  mean  is  the  observed  or  sample  average. 

In  reliability  testing  the  "best  estimate"  is  xhe  observed  proportion  of  »iccesses  or 
failure*.  Anything  else  cannot  qualify  as  a  "best  estimate."  For  example,  the  various  attempts  that 
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have  been  made  to  avoid  the  dilemma  created  by  obtaining  no  failures  in  a  test  sample  include  the 
use  of  the  lower  limit  of  the  50%  confidence  level  as  the  "best  estimate."  This  value  cannot  qualify 
as  a  "best  estimate"  since: 

(1)  The  lower  limit  of  a  confidence  interval  can  rarely  be  an  unbiased  estimate  of  the 
"true  value"  the  interval  is  expected  to  encompass;  (2)  any  lower  confidence  limit  which  equals  or 
exceeds  50%  has  a  larger  variance  than  the  observed  value. 

In  summary,  then,  the  observed  sample  average  (or  proportion)  is  the  only  value  around 
which  a  confidence  interval  should  be  placed. 

2.  CALCULATION  FOR  COMPONENTS 

A.  For  tests  of  increased  severity 

Calculate  the  limits  of  the  confidence  interval  for  X2  as  follows  (ref.  3): 

X2  tS2 

Where: 

X2  =  Average  stress  of  the  failure  distribution,  or  the  stress  at  the  50  percent  point  on 
the  failure  rate  curve  generated  by  a  test  of  increased  severity. 

t  =  Coefficient  by  which  the  standard  deviation  is  multiplied  to  control  the  confi¬ 
dence  level. 

S2  =  Standard  deviation  of  the  failure  rate  curve  (generated  by  a  test  of  increased 
severity)  in  terms  of  the  stress. 

02  =  Sample  size  used  to  obtained  X2 

These  adjusted  values  of  X2  are  then  substituted  for  X2  in  the  above  formula  for  reliability  from 
tests  of  increased  severity  and  the  reliability  recalculated  for  both  limits.  These  recalculated  values 
can  be  taken  as  the  upper  and  lower  limits  of  the  confidence  interval  for  the  average  (point 
estimate)  reliability-in-use. 

3^  Life  tests 

When  the  length  of  time  (tj)  is  observed  for  each  failure  and  the  test  terminated  at  the 
exact  time  (tg)  of  the  last  failure. 

g-Ut/2am^  R^g-Lt/2am 

Where; 

R  =  True  Reliability 
e  *  2.7183 

U  *  Upper  percentage  point  of  the  chi-square  distribution  obtained  from  Appendix  3c 
for  half  alpha  and  2a  degress  of  freedom. 
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L  =  Lower  percentage  point  of  the  chi-square  distribution  obtained  from  Appendix  3c 
for  one  minus  half  alpha  and  2a  degrees  of  freedom 

t  =  Required  failure-free  time. 

m  =  t^-^t2•^t3-^--^ta^^(n-a)ta 
a 

n  =  Number  of  components  tested. 

C.  Attribute-type  data 
a.  Binomial  distribution: 

The  following  technique  is  applicable  when  each  test  specimen  can  fail  in 
only  one  way  and  when  any  one  of  these  conditions  pertain  (page  120  ref  21): 

(1)  The  lot  or  population  represented  by  the  sample  is  very  large  or  infinite. 

(2)  The  sampe  size  is  less  than  10%  of  the  lot  size. 

(3)  Sampling  is  done  with  replacement. 

■  Lower  Limit  (page  373  ref.  23): 

p  =  - a - 

V  a  +  (n-a-H)F^ 

Where: 

Pi  =  Lower  limit  of  the  confidence  interval  for  defects  or  failures.  One  minus  this 
proportion  is  the  upper  limit  of  the  confidence  interval  for  successes. 

a  =  Number  of  defects  or  failures. 

n  -  Sample  size  or  the  total  number  of  trials. 

Fi  =■  Upper  percentage  point  from  a  table  of  the  F-distribution. 

Enter  the  F-table  in  Appendix  3E  with  the  following  values: 

Vi  =  2  (n-a-rl) 

V2  =  2a 
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Upper  Limit: 


(?.-H)  Fy 

^2  ~  {n-'i>  +  .{a+1 )  F2 


Where: 

P2  =  Upper  limit  of  the  confidence  interval  for  defects  or  failures.  One  minus  this 
proportion  is  the  lower  limit  of  the  confidence  interval  for  successes. 

a  =  Number  of  defects  or  failures. 

n  =  Sample  size  or  total  number  of  trials. 

F2  =  Upper  percentage  point  from  a  table  of  the  F-distribution. 

Enter  the  F-table  in  Appendix  3E  with  the  following  values: 

Vi  =  2  (a+1) 

V2  =  2  (n-a) 

These  limits  can  also  be  obtained  directly  from  the  tables  in  Appendix  3B. 
b.  Hypergeometric  distribution: 

This  distribution  is  applicable  when  each  test  specimen  can  fail  in  only  one  way 
and  when  all  of  the  following  conditions  pertain  (page  1 20  ref.  21 ) : 

(1)  The  lot  size  is  small  (finite)  but  can  be  considered  the  population  and  not  a  ran¬ 
dom  sample  of  a  much  larger  volurhe  of  material. 


(2)  Sampling  is  done  without  replacement. 


(3)  The  sample  size  exc^s'tO  percent  of  the  lot  size. 

The  usual  formula  for  the  hypergeometric  distribution  calculates  the  probability 
that  ;i  given  sample  will  contain  exactly  "x"  defectives.  This  calculation  is  based  on  the  size  of  the 
lot  (p  opulation)  when  the  lot  fraction  defective  is  known.  How;ever,  the  converse  of  this  is 
usual  y  required.  Thus,  knowing  the  observed  fraction  defective  in  the  sample,  the  upper  confi¬ 
dence  bound  of  the  fraction  defective  of  the  lot  is  required.  Tables  based  on  the  hypergeometric 
distri  xition  have  been  prepared  from  which  the  desired  information  can  be  obtained  directly 
(see  /Appendix  3H).  In  addition,  the  upper  confidence  bound  of  the  fraction  defective  of  a  finite 
lot  Ct  n  be  estimated  by  multiplying  the  upper  confidence  bound  of  the  fraction  defective  of  an  in¬ 
finite!  lot  by  the  following  factor: 


/  N-n 
N-1 


(seepage  121  ref,  21) 
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Where: 


N  =  The  lot  size. 

n  >  The  sample  size  required  to  calculate  a  given  upper  confidence  bound  of  the 
fraction  defective  in  an  infinite  lot,  using  the  binomial  distribution. 


Care  should  be  taken  in  the  use  of  the  hypergeometric  distribution.  .The  upper  confidence  limit  of 
the  fraction  defective  of  a  finite  lot  is  less  than  that  for  ah  infinite  population  when  each  is  predicted 
from  equivalent  or  identical  samples.  This  comparison  is  shown  in  the  following  table  for  samples 
containing  no  defectives  and  for  the  90  percent  onesided  confidence  level: 


Sample 

Lot 

Proportion  Defective 

Size 

Size 

Hvperqeometric* 

Binomial** 

2 

40 

.675 

.684 

4 

.400 

.438 

8 

.225 

.250 

16 

.100 

.134 

32 

.025 

.070 

5 

100 

.36 

.369 

10 

■  • 

.19 

.206 

20 

.09 

.109 

40 

.04 

.056 

80 

.01 

.028 

10 

200 

.20 

.206 

20 

.10 

.109 

40 

.05 

.056 

80 

.02 

.028 

160 

.005 

.014 

*  Finite  lot  size  taken  as  the  population. 

** Infinite  population. 
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The  hypergeometric  distribution  is  useful  in  acceptance  testing  where  decisions  must 
be  made  about  specific  lots  of  finite  size.  However,  it  should  not  be  used  in  the  development  stock¬ 
pile  phases  of  a  missile  life  cycle.  In  the  development  phase,  decisions  must  be  made  about  lots  of 
indefinite  size.  In  the  stockpile  phase,  decisions  cannot  be  limited  to  the  small  quantity  in  storage; 
at  this  stage  of  the  life  cycle,  there  is  interest,  also,  in  what  the  small  stored  quantity  represents. 
That  is,  small  quantities  are  placed  in  ihe  stockpile  to  further  the  state  of  the  art,  not  to  win  a  war. 
For  this  purpose  decisions  must  be  made  about  the  larger  indefinite  quantities  represented  by  the 
stockpile.  Predictions  in  this  case  require  the  use  of  the  binomial  rather  than  the  hypergeometric 
distribution. 

3.  CALCULATION  FOR  SYSTEMS 

A.  Poisson  Distribution 

When  each  test  specimen  (such  as  a  system)  can  fail  in  more  than  one  way  (ref.  14): 


Where: 

R  =  True  reliability  under  the  test  condition,  as  the  probability  of  zero  failures, 
e  =  2.7183 

U  =  Upper  confidence  limit  of  "c"  (the  counted  number  of  failures)  obtained  from 
Appendix  3D. 

L  =  Lower  confidence  limit  of  "c”  (the  counted  number  of  failures)  obtained  from 
Appendix  3D. 

n  =  Number  of  test  specimens  (systems)  used. 

B.  Other  methods 


When  the  system  reliability  is  calculated,  from  component  reliabilities,  the  lower  bound 
of  the  confidence  interval  can  be  obtained  by  either  of  two  methods  recently  developed  at 
Picatinny  Arsenal:  One  based  on  the  propagation  of  errors  method  to  calculate  the  variance  (ref. 

16)  and  one  based  on  the  Monte  Carlo  method  of  sampling  (ref.  17).  Both  of  these  procedures  are 
lengthy  and  involved.  An  electronic  computer  may  be  needed  to  make  the  calculations  required  by 
either  of  these  methods.. 

However,  before  calculating.a  confidence  limit  for  a  system  reliability  the  following, 
should  be  considered:  ,  ^ 

a.  Confidence  limits  based  on  biased  estimates  are  also  biased.  The  confidence 
level  associated  with  such  limits  is  not  valid.  Reliability  values  obtained  under  conditions  that 
produce  less  than  50%  failures  are  biased  estimates  of  the  true  or  ultimate  reliability. 
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b.  The  magnitude  of  the  differences  between  the  nominal  values  (point  estimate)  of  high 
reliabilities  and  the  lower  confidence  limits  based  6n  their  variances  is  always  very  small  and  of  lirtle 
practical  importance. 

c.  If  the  lower  confidence  limit  of  a  system  reliability  is  to  be  determined,  the  method 
given  above  for  the  binomial  distribution  for  components  can  be  used.  In  this  case  the  number  of 
failures  (a)  equals  n  (1-H)  where  (R)  is  the  system  sample  reliability  and  (n)  is  the  average  sample  size 
which  equals  the  sum  of  the  component  sample  sizes  used  to  determine  (^)  divided  by  the  number 
of  component  types  (or  kinds)  that  comprise  the  system.  This  procedure  is  quick  and  easy  to  calcu¬ 
late  and  is  sufficiently  accurate  for  most  purposes. 

d.  Because  of  the  efficiency  of  testing  entire  systems  as  a  unit,  pointed  out  above  (Section 
VIII  Systems  Reliability),  every  effort  should  be  made  to  test  in  this  manner.  This  procedure  also 
avoids  the  difficult  problem  of  calculating  the  lower  confidence  limit  of  a  system  reliability  derived 
from  component  reliabilities.  Since  the  system  is  the  experimental  unit  (or  test  Specimen)  in  this 
case;  the  confidence  limits  can  be  easily  calculated  by  cither  of  the  following  methods  given  above: 

(1)  The  binomial  distribution  when  the  system  can  fail  in  only  one  way. 

(2)  The  Poisson  distribution  when  the  system  can  fail  in  nwre  than  one  way. 

The  one  exception  to  the  rule  of  testing  systems  as  a  unit  is  in  the  development  phase  where  a  pre¬ 
diction  procedure  is  required. 
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VIII  SAMPLE  SIZE 

1.  INTRODUCTION 

Because  of  economic  considerations,  the  question  of  how  many  specimens  to  test  (or  how 
large  a  sample  size  to  use)  is  always  given  a  prominent  part  in  planning  any  testing  program.  It  is 
the  question  most  often  asked  by  engineers  concerning  testing  programs.  To  answer  this  question 
from  only  the  economic  point  of  view  is  not  enough.  The  cheapest  testing  program  is  none  at  all! 

Of  course,  if  no  testing  is  done  there  is  no  verification  that  the  newly  developed  item  is  useable  dnd 
no  information  concerning  the  condition  of  a  stored  item. 

Before  the  question  of  sample  size  can  be  answered,  the  following  related  points  must  be 
taken  into  consideration; 

A.  The  notion  that  reliability  is  related  to  the  number  of  specimens  tested  must  be  dis¬ 
carded.  Only  the  precision  with  which  the  reliability  is  determined  is  related  to  the  sample  size. 

B.  There  is  no  one  single  sample  size  that  is  applicable  to  all  reliability  testing  programs. 
Each  program  must  be  considered  individually. 

C.  A  valid  sample  size  cannot  be  stated  without  first  knowing  the  purpose  of  the  testing 
program.  It  is  very  easy  to  get  the  right  answer  to  the  wrong  problem. 

The  purpose  of  planning  the  sample  size  prior  to  data  collection  is  to  obtain  essential  in¬ 
formation  with  minimum  cost,  effort,  and  material,  essential  information  being  defined  as  the  rnini^ 
mum  information  required  such  that  additional  data  will  not  change  the  conclusions.  To  accomplish 
this  the  following  design  of  experiment  techniques  must  be  considered,  since  the  question  of  sample 
size  cannot  be  answered  out  of  this  context; 

2.  DESIGN  OF  EXPERIMENT  TECHNIQUES  IN  SAMPLE  SIZE  DETERMINATION 

A.  Purpose  and  Objectives: 

The  purpose  of  any  testing  program  is  to  verify  the  hypothesis  that  objectives  (iriclud- 
ing  requirements)  have  been  achieved  or  maintained.  To  do  so  in  any  valid  quantitative  way,  the 
characteristics  of  the  sampling  and  testing  procedures  must  be  adequate,  and  to  do  so  with  the  mini¬ 
mum  sample  size,  these  procedures  must  be  highly  efficient.  By  efficient  is  meant  maximum  pre¬ 
cision  with  minimum  sample  size. 

B.  Precision  of  Samplirig  Procedures 

In  all  practical  testing  programs,  especially  those  in  which  the  testing  is  destructive, 
something  1^  than  all  of  the  existing  items  should  be  tested  and  from  this  an  inference  made  about 
the  remaining  (usually  larger)  portion  of  items.  To  have  these  inferences  valid  the  sample  must  "re¬ 
present"  the  remaining  portion  of  the  lot  or  population.  If  the  lot  is  homogeneous,  a  representative 
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sample  can  be  obtained  by  random  selection.  That  is,  each  individual  item  in  the  lot  must  have  equal 
change  of  being  selected.  If  the  lot  is  not  homogenous  but  stratified  in  some  manner  according  to 
geographical  location,  weapon,  or  manufacturing  process,  then  the  sampling  plan  must  be  designed 
to  cope  with  this  characteristic  of  the  lot.  If  the  strata  are  only  few  in  number,  then  an  equal  num¬ 
ber  of  randomly  selected  specimens  should  be  selected  from  each  stratum.  The  number  selected 
should  be  apportioned  according  to  the  size  or  importance  of  each  stratum.  If  the  number  of  strata 
!s  large,  then  specimens  should  be  taken  from  only  a  part  of  the  strata;  If  all  strata  are  equivalent, 
then  a  sample  of  the  total  number  of  strata  should  be  randomly  selected  before  the  specimens  within 
them  are  randomly  selected.  If  all  of  the  strata  are  not  equivalent,  then  the  most  important  or 
largest  strata  should  be  used.  In  any  case,  the  actual  selection  of  strata  or  specimens  must  be  done  in 
a  random  manner  either  by  physical  mixing  and  selection,  or  by  numbering  and  determining  which 
numbers  to  select  by  means  of  a  table  of  random  numbers. 

It  is  important  that  the  sample  be  stratified  correctly  to  parallel  that  of  the  lot.  It  is 
only  in  this  way  that  the  heterogeneity  of  the  sample  can  be  kept  to  a  minimum.  Any  increase  in 
the  heterogeneity  of  the  material  due  to  sampling,  results  in  an  inflation  of  the  overall  variation  as 
measured  by  the  standard  deviation  of  the  testing  method.  As  shown  below,  the  magnitude  of  the 
standard  deviation  is  of  prime  importance  in  calculating  sample  size. 

C.  Precision  of  Testing  Method  ' 

The  testing  method  is  in  reality  a  measuring  system  or  device.  It  "measures”  the 
characteristic  of  the  item  being  used  as  a  basis  for  evaluation  and  decision.  As  any  measuring  device, 
the  testing  method  must  be  precise  and  accurate.  By  precise  is  meant  that  characteristic  of  the 
method  that  produces  estimates  (numerical  results)  from  repeated  trials  that  are  close  together  when 
in  fact  there  has  been  little  or  no  variation  in  the  system.  Methods  which  produce  estimates  close 
together  and  do  not  reflect  variations  that  actually  occur  in  the  system  are  called  insensitive  rather 
than  precise  methods.  Obviously  this  type  of  method  is  to  be  avoided. 

It  is  important  to  have  available  the  most  precise  methods  possible,  since,  as  can  be 
seen  below  from  the  formulas,  the  sample  size  varies  directly  as  the  square  of  the  standard  devia¬ 
tion.  The  only  way  precise  methods  can  be  made  available  is  via  a  continuous  program  of  methods 
development. 

D.  Decision  Errors 

Because  all  testing  is  done  on  a  sample  basis,  decisions  (inferences)  must  be  made  about 
the  lot  based  on  the  information  gained  from  the  samolo.  This  in  reality  is  a  form  of  prediction. 

We  all  know  that  predictions  cannot  be  made  with  certciniy.  However,  there  are  only  two  ku  ^iS  of 
error  that  can  be  committed  in  drawing  inferences  about  the  lot: 

a.  Type  I  error  is  rejecting  good  material. 

b.  T ype  1 1  error  is  accepting  poor  material.  It  is  desirable  to  keep  both  of  these 
errors  small.  Their  magnitude  can  be  controlled  by  the  number  of  specimens  (sample  size)  tested 
in  any  given  situation,  as  shown  below.  Ip  practice,  the  magnitude  of  these  errors  chosen  is 

based  on  the  consequence's  of  being  wrong.  (  Tor  example,  the  consequences  of  rejecting  good  mate¬ 
rial  (Type  1  error)  can  cost  only  dollnr- •p*  ■  it  rr  ■  c  •  ■+’  ",  ■  -  ..p„  i- 

error)  can  cost  lives  and  lose  wars.).  ■  ..an,  J..  sample  Le  required  to  rnaii.iaHi  Doth  errors  ol 
the  selected  levels  is  calculated. 


E.  The  Difference  that  Must  be  Detected 

In  a  testing  program  of  any  kind  a  decision  must  be  made  about  at  least  one  of  the 
following  requirements  before  anything  can  be  said  about  sample  size; 

a.  The  maximum  confidence  interval  that  can  be  tolerated  for  the  particular 

purpose  intended. 

b.  The  minimum  difference  (between  two  values)  necessary  to  be  detected  for 
the  purpose  intended. 

These  r^uirements  can  be  established  only  through  knowledge  of  the  objectives  and 
purposes  of  the  system  under  consideration.  Fortunately,  this  kind  of  information  is  usually  well 
known  to  the  engineer.  Sample  size  varies  inversely  as  the  square  of  the  difference  to  be  detected. 
The  sample  size  required  to  detect  a  difference  of  (d/2)  is  four  times  that  required  to  detect  a 
difference  of  (d). 

F.  Experimental  Design 


a.  Multi-variable  Experiments 

If  effect  of  more  than  one  variable  (such  as  effect  of  more  than  one  environment) 
must  be  determined,  experimental  design  is  extremely  important  in  keeping  sample  size  to  a  mini¬ 
mum.  (By  experimental  design  is  meant  the  pattern  or  combination  of  the  variables  used  to  collect 
data.)  If  these  combinations  are  correctly  chosen,  efficiency  of  the  experiment  can  be  greatly  en¬ 
hanced.  In  fact,  the  efficiency  is  improved  by  a  factor  equal  to  the  number  of  variables  included  in 
the  design.  For  example,  to  obtain  a  given  precision,  a  factorial  design  for  three  variables  requires 
only  one-third  the  nunjber  of  test  specimens  required  by  the  classical  one-at-a-time  procedure. 
Factorial  design  for  seven  variables  requires  only  one-seventh  the  number  of  test  specimens  required 
by  the  classical  6ne-at-a-time  procedure.  (A  factorial  design  is  an  experimental  one  in  which  all 
possible  combinations  of  the  variable  levels  are  included  in  the  experiment.)  At  least  one  test  speci¬ 
men  is  required  for  each  combination  used.  When  this  number  becomes  large,  only  a  part  of  the 
total  number  of  combinations  need  be  used  in  designs  called  fractional  factorial  designs.  These 
fractional  designs  have  the  same  high  efficiency  as  the  full  factorial  designs.  These  designs  should  be 
used  to  screen  all  of  the  variables  of  interest  to  find  the  most  important  ones  -  such  as  the  most 
severe  environment. 

b.  Test  of  Increased  Severity 

Because  of  the  exploratory  nature  of  this  test,  an  overall  sample  size  cannot  be 
precisely  predetermined.  The  number  of  test  specimens  required  to  obtain  the  first  failure  depends 
upon  the  magnitude  of  the  existing  safety  margin  and  the  magnitude  of  the  increments  of  stress 
used.  After  the  first  failure  is  obtained,  the  effective  sample  size  is  equal  to  only  one-half  the  total 
number  of  test  specimens  used  in  the  Bruceton  up-and-down  and  the  Two-Stimuli  methods.  How¬ 
ever;  these  methods  are  highly  efficient.  That  is,  high  reliabilities  (if  they  exist)  can  be  demon¬ 
strated  with  small  sample  sizes.  For  example,  a  reliability  of  .995  at  the  90%  (one-sided)  con¬ 
fidence  level  can  be  demonstrated  with  40  to  50  items  with  these  methods.  Higher  reliabilities 
would  require  no  larger  sample  size.  In  addition,  these  methods  make  it  possible  to  calculate 
the  reliability  uruJer  the  use  condition. 
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Without  these  methods  the  above  reliability  would  require  at  least  500  Items 
tested  without  a  failure.  The  reliability  demonstrated  in  this  manner  would  be  under  the  test  con¬ 
dition  only.  It  would  not  be  possible  to  calculate  the  reliability  under  the  use  condition.  To  demon¬ 
strate  higher  reliabilities  (if  they  exist)  would  require  larger  sample  sizes. 

c.  Life  Test 

When  time  is  the  variable  instead  of  the  environment,  as  in  storage  during  Stock¬ 
pile  programs,  the  Poisson  distribution  is  applicable.  In  this  case,  the  sample  size  required  to  demon¬ 
strate  a  given  reliability  is  directly  proportional  to  the  ratio  of  the  required  shelf  life  to  the  length 
of  storage  at  the  time  of  testing.  If  this  length  of  storage  is  short  compared  to  the  expected  shelf 
life,  very  large  sample  sizes  with  very  few  failures  are  required  to  demonstrate  a  reliability  above 
0.90. 


G.  Confidence  Intervals 

A  confidence  interval  is  defined  as  that  interval  around  a  sample  value  (such  as  the 
average)  in  which  we  expect  the  true  (population)  value  estimated  by  the  sample  to  lie.  The  con¬ 
fidence  level  is  a  probability  statement  expressing  the  proportion  of  the  time  the  tme  value  can  be 
expected  to  be  within  the  stated  interval.  The  confidence  level  is  the  complement  of  the  Type  I 
error.  That  is,  one  minus  alpha  equals  the  confidence  level.  Where  alpha  is  the  probability  of  being 
wrong  (in  error),  the  confidence  level  is  the  probability  of  being  right  in  our  predictions.  These 
probabilities  can  be  measured  by  the  area  under  a  frequency  distribution  curve,  such  as  the  normal 
curve.  As  a  consequence,  there  are  two  ways  in  which  an  area  equal  to  alpha  can  be  cut  off. 

a.  By  cutting  off  an  area  equal  to  alpha  all  in  one  tail  of  the  curve. 

b.  By  cutting  off  an  area  equal  to  one  half  of  alpha  in  both  tails  of  the  curve. 

Either  way,  the  confidence  level  is  the  same  for  a  given  alpha  value.  To  distin^ish  between  these 
two  ways  the  first  is  called  a  "one-sided"  or  "one-tail"  level,  and  the  second  way  is  called  a  "two- 
sided"  or  "two-tail"  level. 

Tne  one-and  two-sided  confidence  levels  have  distinctly  different  uses: 

a.  If  there  is  interest  in  only  one  confidence  limit,  the  one-sided  level  should 

be  used. 

b.  If  there  is  interest  in  both  confidence  limits,  the  two-sided  level  should  be 

used. 

The  decision  concerning  which  type  of  confidence  level  and  what  magnitude  of 
confidence  level  to  use  in  any  given  situation  must  be  made  prior  to  obtaining  the  data.  The 
type  of  level  must  be  based  on  the  need  for  one-  or  two-limit  intervals,  and  the  magnitude  of  level 
must  be  based  on  the  consequences  of  being  wrong.  To  make  these  decisions  after  seeing  the  data 
affects  the  value  of  the  confidence  level  associated  with  a  given  confidence  interval.  Probability 
statements  derived  from  a  set  of  data  are  not  applicable  to  that  set  of  data.  The  fact  that  one¬ 
sided  confidence  levels  for  reliability  are  higher  than  two-sided  levels  Is  not  a  valid  reason  for 
choosing  one-sided  confidence  levels. 


With  these  considerations  in  mind,  tne  sample  size  required  for  a  given  confiden  je  in¬ 
terval  can  be  calculated  as  shown  below.  Converseiv,  for  a  given  sample  size,  the  magnitude  cf  the 
associated  confidence  interval  can  be  calculated.  However,  for  variable  type  data  the  star.di'-d  devi¬ 
ation  must  be  known. 

H.  Testing  Hypotheses 


Tests  of  hypotheses  are  used  to  compare  two  or  more  values,  such  as  reliability  values. 
The  purpose  of  tests  of  this  kind  is  to  determine  whether  observed  differences  are  due  to  chance 
variations  or  whether  they  are  due  to  assignable  causes.  This  is  important  in  decision  making.  To 
decide  that  the  reliability  value  obtained  during  the  second  testing  period  is  smaller  then  that  ob¬ 
tained  during  the  first  testing  period  is  very  disconcerting  if  the  value  obtained  in  the  third  testing 
period  is  larger  than  the  first  reliability  value  obtained.  This  is  especially  disturbing  if  the  decision 
has  led  to  more  testing  or  replacement  of  parts,  but  this  is  exactly  what  can  happen  if  the  observed 
differences  are  due  to  chance  variations.  Only  through  use  of  statistical  tests  of  significance  can  this 
difficulty  be  avoided. 

In  hypotheses  testing  both  the  alpha  (Type  1)  error  and  the  beta  (Type  II)  error  should 
be  controlled  to  prevent  difficulties  of  the  kind  described  above.  The  beta  error  is  especially  im- 
poiant  in  Ordnance  work  because  of  the  consequences  of  being  wrong.  The  only  way  that  these 
errors  can  be  controlled  at  predetermined  values  is  to  calculate  the  sample  size  required  to  do  so  in 
advance  of  data  collection.  Experiemce  has  shown  that  when  these  two  kinds  of  errors  are  kept  at 
5%  or  below,  the  risk  of  making  a  wrong  decision  is  sufficiently  low  for  most  purposes.  To  reduce 
these  errors  below  1%  requires  very  large  sample  sizes. 

I.  Other  Considerations 

For  lots  made  up  of  discrete  items  from  which  only  attribute  (success  or  failure)  data 
can  be  ootained  the  following  additional  considerations  should  be  made: 

a.  Lot  Size  vs  Sample  Size 

If  the  lot  is  finite  in  size  and  less  than  ten  times  the  size  of  the  sample 
selected  then  this  fact  h.itst  be  taken  into  account.  The  action  taken  in  this  regard  depends  upon  the 
purpose  of  the  testing  and  the  scope  of  the  conclusions  drawn  as  described  below. 

b.  Disposition  of  Selected  Specimens 

If  the  testing  done  destroys  the  specimens  selected  or  if  the  specimens  are  not 
returned  to  the  lot  for  any  other  reason,  this  fact  must  be  taken  into.account.  Again  the  action  ■ 
taken  in  this  regard  depends  upon  the  purpose  of  the  testing  and  the  scope  of  the  conclusions  drawn 
as  described  below. 

c.  Purpose  of  Testing 

A  decision  should  be  made  prior  to  data  collection  concerning  the  purpose  of 
the  testing,  if  the  purpose  is  to  draw  a  conclusion  about  only  those  items  in  a  small  (finite)  lot 


and  if  both  of  the  two  above  conditions  oertain,  then  the  sample  size  can  bd  reduced  slight? , 
through  use  of  the  hypergeometric  distribution.  This  distribution  finds  its  most  frequent  use  in 
acceptance  testing  where  the  purpose  is  to  predict  the  expectea  frac*'-'  * -fective  of  a  particular 
small  lot  of  items.  If  such  a  lot  is  placed  in  stockpile,  however,  then  the  hyoergeometric  assump¬ 
tion  is  no  longer  applicable  since  the  purpose  of  testing  is  nov/  different.  Sm3?i  lots  of  material 
in  the  stockpile  represent  larger  lots  of  indefinite  size.  The  characteristics  of  ti  "faterial  are 
studied  and  recorded  for  their  value  in  future  applications.  That  is,  the  purpose  c'  lasting  is  to 
draw  inferences  about  the  larger  volume  of  material  represented  by  the  small  lot  on  hand.  In  this 
latter  case,  only  the  binomial  assumption  concerning  lots  of  Infinite  size  is  applicable. 

3.  CALCULATION 

A.  Sample  size  required  for  a  given  confidence  interval 

a.  Variable  data 

(ts)2 


Where; 

n  =  Sample  size 

t  =  Standard  deviate  associated  with  the  alpha  error  used  to  control  the  confidence 
level. 

s  =  Sample  standard  deviation. 

d  =  Magnitude  of  the  confidence  interval  in  the  same  units  as  the  standard  deviation, 
b.  Attribute  Data 

(1)  Binomial  Distribution 

There  is  no  easy,  practical  way  accurately  to  calculate  the  sample  size  required 
for  attribute  data.  The  accurate  methods  are  difficult  to  calculate  and  the  simple,  easy  methods  are 
not  cccurate.  The  most  practical  method  is  to  refer  to  one  of  the  existing  tables  for  binorhial  con¬ 
fidence  intervals  to  find  the  sample  size  required  for  a  given  interval.  Tables  useful  for  this 
purpose  are; 

One-Sided  Limits: 

Appendix  3B  . 

Two-Sided  Limits: 

Appendix  3B 
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(2)  Hyperqecmetric  Distribution 


As  with  the  binomial  distribution,  there  is  no  easy,  direct  way  to  calculate  the 
sample  size  for  the  hypergeomstric  distribution.  The  most  practical  way  to  arrive  at  a  sample  size  in 
this  case  is  to  refer  to  one  of  the  existing  tables  for  the  hypergeometric  confidence  intervals.  From 
these  tables  the  sample  size  for  a  given  interval  and  confidence  level  can  be  read  directly.  Tables 
useful  for  t'lls  purpose  can  be  found  in  Appendix  3H. 

Alternatively,  the  sample  size  required  in  a  hypergeometric  distribution  can 
be  estimated  by  multiplying  the  sample  size  for  the  binomial  distribution  by  N/{N+n)  . 

Where: 

N  =  Lot  size 


n  =  Sample  size  required  in  the  binomial  distribution. 

B.  The  sample  size  required  to  detect  a  given  difference  between  two  sample  values  in 
testing  a  hypothesis: 

a.  Variable  Data 


n  =  2 


(ti  +t2) 

d 


2 


Where: 


n  =  Sample  size 

t,  =  Standard  deviate  associated  with  the  alpha  error 
t2  =  Standard  deviate  associated  with  the  beta  error, 
s  =  Sample  standard  deviation 
d  =  Difference  that  must  be  detected.  ‘ 
b.  Attribute  Data  .  ■  ■ 

As  mentioned  above  there  is  no  easy  practical  way  to  calculate  the  sample  size  for 
^tribute  data.  The  sample  size  tor  hypothesis  testing  using  attribute  data  can  best  be  determined 
from  the  tables  for  minimum  contrasts  in  Appendix  3A.  These  tables  give  values  in  the  following 
format: 


Minimum  Contrasts  Required  for  Significance  at  the  95%  Level 
No.  of  A's  in  sample  (1)/No.  of  A's  in  Sample  (2) 


4 

0/4 

1/- 

■ 

5 

.  0/4 

1/5 

21- 

10 

0/5 

2/8 

3/9,  etc. 

20 

0/5 

1/7 

2/9 

3/10,  etc. 

In  this  table  N  is, the  sample  size.  The  values  in  the  body  of  the  table  that  appear 
to  be  proportions  are  written  in  a  short-hand  method  which  mean  the  following: 

For  a  sample  size  of  5,  the  value  in  the  first  column  of  this  row  (0/4)  means 
that  if  no  failures  are  obtained  in  the  first  sample  of  5,  at  least  4  failures  must  occur  in  the  second 
sample  of  5  before  the  observed  difference  can  be  declared  significant  at  the  95%  level  of  confi¬ 
dence.  This,  in  turn,  means  that  a  sample  size  of  5  can  only  detect  differences  of  80%  or  greater. 
Larger  sample  sizes  can  detect  smaller  proportional  differences.  The  use  of  these  tables  can,  of 
course,  be  reversed  to  find  the  sample  size  required  to  detect  a  given  difference. 

C.  Sample  size  required  in  storage  programs  where  time  is  the  variable: 

N  =  -1- 

1-R 

Where; 

N  =  Sample  size 
a  =  Number  of  failures  in  time  (h) 
h  =  Length  of  storage 
R  =  Required  reliability 


IX 


LABORATORY  TEST  METHODS  FOR  COMPONENTS 


1.  INTRODUCTION 

It  is  assumed  in  these  methods  that  the  test  item  can  fail  in  but  one  way.  That  is,  the 
binomial  distribution  is  applicable. 

Plans  should  be  made  to  conduct  the  laboratory  experiments  in  two  stages: 

A.  Survey  the  separate  effects  of  the  several  environmental  conditions  of  interest  in 
one  integrated  factorial  experiment  to  select  the  environments  causing  the  highest  failure  rates. 

B.  Determine  the  ultimate  reliability  by  means  of  a  test  of  increased  severity  (testing  to 
failure)  using  the  treatment  (environment)  found  most  severe  in  the  factorial  experiment. 


2.  FACTORIAL  DESIGNS 


A.  Advantages 

The  two-to-the-n^*^  factorial  designs  or  their  optimized  modifications  are  the  most 
efficient  experimental  methods  known  for  selecting  the  treatments  causing  the  highest  failure  rates. 
This  approach  will  reduce  the  magnitude  and  complexity  of  the  experiments  required  to  determine 
reliability.  More  important,  all  component  reliabilities  obtained  in  this  manner  will  have  a  common 
basis  of  determination  because  the  reliability  of  each  component  is  defined  in  terms  of  the  environ¬ 
ment  which  has  been  experimentally  found  to  cause  the  highest  failure  rate.  This  results  in  pre¬ 
dicting  the  minimum  reliability  with  respect  to  the  separate  environments  for  each  component.  If 
all  these  reliabilities  are  acceptable  the  reliabilities  associated  with  all  the  other  envirbnments  will 
also  be  acceptable.  Only  in  this  way  can  valid  and  realistic  system  reliabilities  be  derived  from 
component  reliabilities. 

See  Appendix  4  for  some  of  the  more  useful  two-to-the-n^*^  factorial  designs  in  the  form 
of  worksheets.  These  designs  are  the  most  efficient  known.  Experiments  based  on  these  designs 
may  be  conducted  without  changing  the  treatment  procedure  except  to  arrange  for  the  test 
specimens  to  receive  the  number  and  kind  of  treatments  required  by  the  particular  design  used. 
However,  the  best, differentiation  among  treatments  is  obtained  when  the  level  of  severity  used  will 
cause  50  percent  of  the  test  specimens  to  fail.  This  may  cause  some  adjustment  of  the  levels  of  the 
treatments  used. 

For  the  purpose  of  this  application,  the  two  levels  of  each  treatment  can  be  the  presence 
and  absence  of  the  treatment.  Alternatively,  any  two  levels  of  the  treatment  can  be  used. 
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The  number  of  test  specimens  required  in  the  optimized  designs  is  one  more  than  the  total 
number  of  treatments  used  (ref.  5).  The  more  versatile  fractional  factorial  designs  (ref.  6)  require 
at  least  16  items  for  experiments  containing  from  five  through  eight  treatments,  and  at  least  32 
items  for  niqe  through  13  treatments.  With  twice  these  numbers  of  items,  the  latter  type  designs 
can  also  measure  interactions,  i.e.,  how  the  effect  of  any  one  environment  depends  upon  the 
others.  Interactions  among  treatments  cannot  be  measured  except  by  factorially  designed  experi¬ 
ments. 


Factorial  designs  permit  a  type  of  statistical  analysis  that  distinguishes  between  variations 
due  to  chance  and  variations  having  assignable  causes,  thereby  producing  more  information  from  a 
given  number  of  items  than  any  other  known  procedure.  These  designs  actually  Increase  the  effective 
sample  size  by  making  it  possible  to  use  each  observation  (or  measurement)  for  more  than  one  pur¬ 
pose. 

In  fact,  each  treatment  effect  is  determined  as  though  the  entire  experiment  is  conducted 
to  determine  that  particular  treatment  effect  alone.  As  a  result,  each  treatment  effect  is  determined 
with  a  precision  equal  to  the  total  number  of  items  used  in  the  experiment.  The  three-treatment- 
design  example  described  below  demonstrates  this  point. 

Further  advantages  in  using  factorial  designs  in  environmental  testing  experiments  follows: 

a.  No  control  groups  are  required. 

b.  Each  treatment  effect  can  be  deterrriined  independently  of  all  others.  Thus,  unambiguous 
conclusions  can  be  drawn  about  each  treatment  effect. 

c.  Complex  experiments  involving  a  large  number  of  treatments  can  be  easily  handled  with 
factorial  procedures. 

d.  This  is  the  only  experimental  design  in  which  the  relationship  amongthe  treatments  can 
be  measured.  The  factorial  design  can  determine  whether  the  effect  of  one  environmental  treatment 
depends  upon  any  of  the  others.  These  effects  are  catl^  interactions. 

e.  The  probability  of  being  ri<if  r  v  rong  can  be  controlled. 

f.  When  the  number  of  treatmc  ii.,  ixd  becomes  large  (three  or  more),  only  a  fraction 
(1/2,  1/4,  1/8,  etc.)  of  the  total  number  of  combinations  in  a  factorial  design  need  be  used. 

When  multiple  replications  cannot  be  used  and  only  attribute  (go,  no-go)  data  are 
available,  these  designs  can  still  be  used  to  take  advantage  of  their  efficiency.  However,  in  cases  of 
this  kind  the  usual  analysis  of  variance  cannot  be  made.  Instead,  the.  usual  summations  are  made  to 
obtain  and  compare  two  binomial  proportions  (by  the  Fisher  exact  method)  to  determine  the  effect, 
of  each  treatment.  See  example  No.  1  below. 

Results  of  factorial  experiments  are  used  as  a  guide  to  select  whch  environment  to  use 
for  determining  reliability  prior  to  conducting  the  test  of  increased  severity. .  The  factorial  experi¬ 
ment  surveys  all  of  the  environmeri.ai  treatments  of  interest  (with  a  minimum  number  of  test 
specimens'  to  determine  the  difference,  if  any,  amongthe  environmental  effects.  Adecision  is  then 


made  whether  to  redesign  the  item.  If  the  item  is  considered  acceptable  at  this  time,  reliability  is 
determined  using  the  environmental  treatment  or  treatments  found  to  be  most  severe.  If  no  dif¬ 
ferences  are  found  among  the  effects,  reliability  can  be  determined  by  using  a  combination  of  seve-  H 

ral  of  the  treatments  considered  most  important  from  an  engineering  point  of  view.  If  reliability 
is  determined  by  using  the  most  severe  treatments,  the  reliability  values  obtained  will  be  lower  than 
those  obtained  with  the  other  treatments.  This  is  a  necessary  condition  if  the  system's  reliability 
derived  from  the  component's  reliabilities  is  to  be  useful. 

B.  Full  factorial  designs  (ref.  18). 

These  designs  require  more  specimens  per  treatment  than  do  the  fractional  factorial 
designs,  but  they  are  the  only  class  of  designs  that  can  measure  a//  of  the  interaction  effects.  A  full 
factorial  can  be  formed  by  writing  dcwn  ail  of  the  combinations  of  "n"  treatments,  each  at  two 
levels  in  a  multi-entry  table.  For  example,  a  full  two-cubed  factorial  can  be  written  as  follows: 

2^  FACTORIAL  DESIGN 


LL 


■'2 


(1) 

c 


b 

be 


a 

ac 


ab 

abc 


The  lower  case  letters  and  the  symbol  ( 1 )  in  the  body  of  the  table  identify  each  of  the  eight  (2^  =  8) 
treatment  combinations  that  constitute  this  design.  These  combinations  are  derived  from  their 
position  in  the  table.  For  example,  the  symbol  (1)  is  located  by  Al  Bi  Cl  which  means  that  all 
three  treatments  are  at  their  lower  level.  The  lower  case  letters  (ac)  are  located  by  A2  Bi  C2 
which  means  that  treatments  A  and  C  are  at  their  higher  levels  and  that  treatment  B  is  at  its  lower 
level.  In  this  code  the  lower  ease  of  the  treatment  letter  appears  in  the  combination  only  when  the 
treatment  is  at  its  higher  level.  This  results  in  the  formation  of  all  possible  combinations  of  "n" 
things  (treatments)  taken  0,  1,2,  ...  and  n  at  a  time.  At  least  one  test  specimen  or  observation  is 
required  for  each  of  the  treatment  combinations.  Two  or  more  observations  at  sach  treatment 
combination  are  required  for  an  independent  estimate  of  experimehtal  error.  A  i  equal  number  of 
observations  at  each  treatrnent  combination  is  required  to  keep  the  design  ortho|gonal. 

C.  Fractional  factorials  (ref.  6) 


As  the  number  of  treatment  variables  increases,  the  number  of  trea 
tions,  and  therefore  the  number  of  test  specimens  required  for  a  complete  replica' 
very  rapidly.  At  the  same  time  the  number  of  higher  order  interactions  that  can 
increases  very  rapidly.  This  results  in  two  undesirable  situatio~s: 


Itment  combina¬ 
tion,  increases 
be  measured  also 


a.  The  number  of  test  specimens  required  is  too  large. 


b.  The  information  in  the  higher  order  interactions  (three-factor 
above)  is  of  little  practical  use.  Fractional  factorial  designs  were  developed  to 
tions  and  thereby  improve  the  efficiency  of  designs  for  multi-factor  experimentt 


i  iteractions  and 
iivoid  these  situa- 
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When  less  than  all  of  the  possible  combinations  in  a  factorial  aesign  are  used,  the  design 
is  said  to  be  a  fractional  factorial.  For  the  iwo-fo  the-nth  series  there  can  be  half,  quarter,  eighth, 
sixteenth,  etc.  portions  of  the  full  factorial  used.  These  portions  are  called  fractional  replicates, 
where  a  full  factorial  is  one  replicate. 

Fractional  factorials  cannot  be  used  without  losing  or  giving  up  some  information  that  is 
available  in  the  full  factorial.  However,it  is  planned  in  designing  a  fractional  factorial  to  lose  only  the 
least  important  part  of  the  information.  Experience  has  shown  that  the  higher  order  interactions 
in  a  full  factorial  are  the  least  important.  This  fact  is  made  use  of  by  equating  new  treatments  to  the 
higher  order  interactions.  To  equate  one  such  interaction  to  a  new  variable  in  a  full  2®  factorial, 
for  example,  creates  a  half  replicate  of  a  2^  factorial.  Detailed  procedure  for  designing  fractional 
factorials  can  be  found  in  reference  18.  At  least  one  observation  for  each  treatment  combination  is 
required  to  keep  these  designs  orthogonal. 

D.  Treatment  procedure 

The  factorial  designs  described  in  Appendix  4  are  those  most  frequently  used  in  environ¬ 
mental  experiments.  They  are  described  in  the  form  of  treatment  procedure  worksheets  to 
facilitate  their  use.  These  worksheets  show,  in  an  easy-to-follow  manner,  how  to  treat  each  test 
specimen  in  the  various  fractional  factorial  designs  represented.  They  can  also  be  used  to  record 
and  analyze  the  test  results.  A  blank  space  in  the  item  column  means  that  the  item  does  not  receive 
the  corresponding  treatment.  A  plus  mark  in  the  item  column  means  that  the  item  receives  the 
corresponding  treatment.  The  combinatipns  of  blank  spaces  and  plus  marks  in  the  worksheets  corre¬ 
spond  to  the  treatment  combinations  in  the  respective  fractional  factorial  designs.  The  choice  of 
these  designs  should  be  based  on  the  following  considerations: 

a.  The  number  of  treatment  effects  that  must  be  determined. 

b.  Whether  interactions  can  be  expected  to  be  present. 

c.  The  precision  required. 

d.  The  number  of  test  specimens  available  or  that  can  be  made  available. 

These  considerations  should  be  made  in  the  order  named. 

,  The  blocks  in  which  some  of  the  designs  are  divided  are  for  the  primary  purpose  of 
breaking  the  experiment  into  homogeneous  parts  with  respect  to  testing  equipment  used,  OF>erators 
conducting  the  exp>eriment,  or  climatic  conditions,  such  as  season  of  the  year,  etc.  If  alt  such 
things  can  be  considered  constant,  then  these  blocks  can  be  identified  with  other  conaitions  whose 
effect  it  is  desired  to  evaluate,  such  as,  firing  conditions,  functioning  conditions,  temperature 
ronriitions,  or  different  lots  of  material.  Identifying  the  blocks  with  different  conditions  or 
material  does  not  affect  the  determination  of  the  treatment  effects.  The  important  consideration 
is  that  conditions  be  held  constant  and  materials  be  homogeneous  within  the  block. 


E.  Analysis 


An  example  of  one  type  o^  analysis  that  can  be  used  with  factorial  designs  is  given  in 
Appendix  1 .  This  is  the  simplest  possible  analysis.  The  type  of  analysis  that  can  be  made  depends 
upon  the  class  of  design  used,  the  kind  (attribute  or  variable)  and  amount  (number  of  replications) 
of  data,  and  the  way  (at  random  or  in  blocks)  data  were  collected.  Some  types  of  analysis,  such  as 
the  analysis  of  variance,  are  quite  complicated.  As  a  result,  the  subject  of  the  analysis  of  variance 
(ref.  18)  is  not  included  here.  It  is  recommended  that  statistical  analysis  of  this  kind  be  conducted  by 
statisticians. 


3.  TESTS  OF  INCREASED  SEVERITY 


A.  Introduction 

These  methods  need  be  used  only  when  one  of  the  following  situations  pertains: 

a.  The  occurrence  of  a  failure  cannot  be  detected  by  visual  inspection  at  the  time 
of  occurrence,  as  it  is  in  a  tensile  test. 

b.  The  magnitude  of  the  strew  at  the  time  of  failure  is  not  observable,  as  it  is  in 
the  tensile  test. 

The  intended  use  of  these  methods  is  to  determine  the  magnitude  of  the  stress  at  the  point  of 
failure  (where  the  stress  equals  the  strength),  when  this  value  is  not  directly  observable,  as  in  the 
case  of  the  effect  of  vibration  on  timing  accuracy. 

The  level  of  severity  can  be  increased  in  a  variety  of  ways,  such  as  the  following: 

a.  Using  more  extreme  levels  of  treatment  (e.g.,  higher  or  lower  temperatures, 
higher  or  lower  G-values,  or  higher  or  lower  voltages). 

b.  Applying  two  or  more  treatments  simultaneously. 

c.  Increasing  the  length  of  time  the  treatment  is  applied,  as  in  storage  tests. 

When  variable  (quantitative)  data  (such  as  resistance  in  ohms,  elongation  in  oercent  or 
closing  time  in  seconds)  are  ootained,  it  is  necessary  to  compare  each  observed  value  with  the  re¬ 
quired  value  in  order  to  determine  success  or  failure. 

B.  Bruceton  up-and-down  method  (ref.  3) 

Starting  with  the  most  severe  condition  expected  in  use,  test  one  new,  unused  item. 

If  the  item  does  not  fail,  increase  the  level  of  severity  (the  stress)  one  increment*  and  again  test  one 


’This  value  can  be  estimated  by  didiving  the  difference  between  the  maximum,  and  minimum  in-use 
conditions  by  six.  This  is  based  on  the  assumption  that  the  extreme  in-use  conditions  are  the 
3-sigma  limits.  , 


new,  unused  item.  Continue  this  process  of  increasing  the  stress  one  increment  at  a  time  and  testing 
one  new,  unused  item  at  each  increment  of  stress  until  the  first  failure  is  obtained.  Then  reverse 
the  process  by  decreasing  the  stress  one  increment  at  a  time  and  testing  one  new,  unused  item  at 
each  increment  of  stress  until  a  success  is  obtained.  Repeat  the  process  of  increasing  the  stress  to 
failure  ond  decreasing  the  stress  to  success  unxil  at  least  25  ♦est  specimens  are  used  after  the  first  failure. 
Calculate  the  level  o^  severity  at  which  50%  of  the  specimens  fail,  and  the  associated  standard  devia¬ 
tion  by  the  method  described  in  Chapter  19  of  ref.  3,  using  the  number  of  failures  for  these  calcula¬ 
tions. 

With  this  information  the  "reliability-in-use"  can  be  predicted.  See  the  examples  in 
Appendix  1  for  details  of  the  calculations. 

When  the  form  of  the  distribution  curve  is  not  known  or  is  in  doubt,  Chebyshev's  inequality, 
can  be  used.  This  technique  is  valid  for  any  distribution  without  an  assumption  concerning  its 
for.m.  The  inequality  states  that  the  amount  of  area  under  any  distribution  curve  which  is  farther  away 
from  the  mean  than  k  standard  deviation  units  is  less  than  l/k2.  The  reliability  calculated  by  this 
procedure  will  always  be  less  than  the  true  value. 

When  the  form  of  the  failure  distribution  curve  is  practically  normal,  as  shown  by  its 
cumulative  frequency  approximating  a  straight  line  on  linear  probability  paper,  probability  values 
can  be  found  by  entering  a  table  of  areas  under  a  standard  normal  curve  with  calculated  normal 
deviates,  which  equals  the  difference  between  any  two  levels  of  severity  divided  by  the  standard 
deviations. 

C.  Churchman  two-stimuli  method  (ref.  10) 

Test  one  new,  unused  item  at  the  most  severe  condition  in  use.  If  the  item  does  not 
fail,  increase  the  level  of  severity  (the  stress)  one  increment*  and,  again,  test  one  new,  unused  item. 
Continue  this  process  of  increaS{ing  the  stress  one  increment  at  a  time  and  testing  one  new,  unused 
item  at  each  increment  of  stress  until  the  first  failure  is  obtained.  This  procedure  should  cause  the 
first  failure  within  5  to  10  trials,  depending  oh  the  magnitude  of  the  safety  margin.  Using  the  level 
of  severity  causing  the  first  failure,  test  10  to  20  items  to  determine  the  proportion  of  failures  at 
this  point.  Record  this  proportion  and  the  level  of  severity  used.  Then  change  the  stress  by  an  amount 
equal  to  about  two  or  three  increments.  If  the  first  proportion  of  failures  exceeds  50  percent,  de¬ 
crease  the  stress,  and  if  the  first  proportion  is  less  than  50  percent,  increase  the  stress  to  find  a  second 
point  on  the  curve.  Determine  the  proportion  of  failures  at  this  point  as  before  and  record  this  pro¬ 
portion  and  the  level  of  severity  used.  , 

The  object  is  to  find  two  levels  of  severity  such  that  the  proportion  of  failures  differ 
by  at  least  20  percent,  and  yet  have  the  proportions  more  than  zero  percent  and  less  than  100  per¬ 
cent.  From  this  information  calculate  the  average  and  standard  deviation  of  the  failure  rate  by  the 
method  described  in  Reference  No.  10.  Alternatively,  the  average  and  standard  deviations  can  be 
obtained  graphically  by  plotting  the  proportion  of  failures  against  the  corresponding  stress  level 
on  linear  probability  paper.  Draw  a  straight  line  through  the  two  points.  The  average  stress  is 
that  stress  corresponding  to  50  percent  failures.  The  standard  deviation  is  equal  to  the  difference 


•  One  sixth  of  the  difference  between  the  expected  maximum  and  minimum  use  conditions. 
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between  the  stress  at  the  16  percent  point,  and  the  stress  at  the  50  percent  point.  By  using  these 
values,  the  reliability-in-use  can  be  calculated  as  described  in  Appendix  1. 

D.  Discussion  of  methods. 


Which  of  these  methods  will  be  suitable  for  use  in  any  particular  situation  depends  upon 
the  intended  purpose  of  the  experiment.  The  choice  can  be  based  upon  the  distinguishing  charac¬ 
teristics.  Both  methods  are  equally  efficient,  as  they  both  require  the  same  sample  size  for  a  given 
precision. 


The  two-stimuli  method  should  be  used  when  either  of  the  following  physical  condi¬ 
tions  exists: 


a.  The  test  results  are  not  immediately  available  after  each  trial.  This  would  cause  un¬ 
due  delay  in  conducting  the  Brucetbn  method  which  requires  that  all  trail  results  be  known  before 
the  condition  for  the  next  trial  can  be  determined. 

b.  The  physical  changing  of  the  test  conditions  is  difficult.  This  would  cause  undue 
work  in  conducting  the  Bruceton  method  which  requires  changing  the  test  condition  after  each 
trial. 


E.  Method  characteristics 

a.  Bruceton  method 

(1)  Advantage: 

This  method  leads  directly  to  the  50  percent  point  with  the  greatest  efficiency. 

(2)  Disadvantages: 

(a)  The  standard  deviation  should  be  known  in  advance^ 

(b)  Tests  must  be  conducted  in  sequence,  as  the  results  of  each  test  must  be 
known  before  the  next  is  conducted. 

(c)  Test  conditioris  must  be  changed  after  each  trial. 

b.  Two-stimuli  method. 

(1)  Advantages: 

(a)  A  number  of  trials  can  be  conducted  concurrently. 

(b)  Only  two  points  on  the  curve  are  r^uired. 

(c>  This  method  can  be  extended  so  that  more  than  two  points  are  determined. 
If  this  is  dorte  the  form  of  the  distribution  can  be  determined. 
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two  points. 


(2)  Disadvantages: 

(a)  The  fornri  of  the  strength  distribution  curve  cannot  be  determined  with  only 


(b)  The  assumption  of  normality  is  required  when  only  two  points  are  used. 
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APPENDIX  I 
EXAMPLES 


A.  Confidence  Interva’;: 

a.  Life  tests.  A  sample  of  20  components  In)  .  -hich  are  required  to  operate  for  240 
hours  (t),  were  subjected  to  a  specified  use  condition  for  a  period  of  120  hrs.  when  the  first  com¬ 
ponent  failed.  The  failure  rate  was  assumed  to  be  relatively  constant  and  so  the  test  was  discon¬ 
tinued  at  this  point  in  time  (120  hrs.). 

The  sample  point  estimate  for  reliability  can  be  caiuclat^  as  follows: 


When:  e =2.7183 

m=i2U20±i20Ji12g  ^  2400 
1  1 

t  =  240  hours. 

=  (2.7183)'240/2400  =  90 

This  is  the  point  estimate  of  the  probability  of  no  failures  in  240  hours.  The  90  percent 
two  sided  confidence  interval  for  R  can  be  calculated  as  follows: 

eUt/2am  ^R>e-Lt/2am  ^ 

When: 

e  *  2.7183  ; 

U  *  5.99  (from  Appendix  3C  lor  half  alpha  and  2a  degrees  of  freedom). 

L  *  0.103  (from  Appendix  3C  for  one  minus  half  alpha  and  2a  degrees  of  freedom) 
a  »  1  (the  number  of  failures) 

m  =*  2400 
t  =  240 

alpha  *  (1-0.9)  *0.1 


(2.7183)  <5-99)  (240)/2x1  (2400)  <  r  >  (2.7183)  <0  ’03)  (240)/2x1  (2400) 

(2.7183)  °-3  <  R  >  (2.7183)'0-995 

Confidence  interval: 

0.74<  R>  0.995 

b.  Binomial  type  data.  —  A  sample  of  20  items  was  taken  from  a  lot  of  1 00  components 
and  tested  under  the  use  condition.  No  failures  were  obtained. 

To  accept  this  specific  lot  the  lower  limit  of  the  90  percent  one  sided  confidence  limit  for 
the  reliability  should  be  taken  frorn  the  tables  in  Appendix  3H  which  are  based  on  the  hypergeo¬ 
metric  distribution.  The  value  found  in  these  tables  is  9  defectives  in  the  original  lot  of  100  items. 
Frorn  this  then  the  lower  limit  for  the  true  reliability  of  the  lot  is: 

R  (lower  limit)  =  1  -  9/100  =  0.91 

On  the  assumption  that  this  value  is  acceptable  and  the  lot  is  placed  in  the  stockpile  for 
further  testing,  the  reliability  of  the  items  that  this  lot  represents  should  now  be  determined  from 
the  tables  in  Appendix  3B  which  are  based  on  the  binomial  distribution.  From  these  tables,  the 
lower  limit  of  the  true  reliability  of  the  items  the  lot  represents  is: 

R  (lower  limit)  =  1 .000  -  0.109  =  0.881 

c.  Systems:  (1)  A  group  of  10  telemetered  missiles  were  flight  tested.  The  number  of 
failures  found  in  each  missile  is  as  follows: 

Missile  number  Number  of  failures 

1  0 

2  0 

3  0 

4  0 

5  0 

6  0  . 

7  0 

8  3 

9  0 

10  0 

Total  3 
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The  point  estimate  for  reliability  as  the  probability  of  no  failures  under  the  test  condi- 
ion  can  be  calculated  as  follows; 

R  =  e'^ 

When:  X  =  3/10 
Point  estimate: 

R  =  {2.7183)-°-3  =  0.74 

The  90  percent  two  sided  confidence  interval  for  the  true  reliability  (R)  can  be  calculated 
s  follows: 

e-U^"<R<e‘-/" 

When: 

e  =  2.7183 

U  =  7.75  (from  Appendix  3D). 

L  =  0.818  (from  Appendix  3D), 

n  =  10 

(2.71 83)'^*^®''^ R  <  (2.7133)‘^-S^S/^0 


Confidence  Interval: 
0.46  <  R  <  0.92 


The  point  estimate  and  90  percent  two  sided  confidence  interval  calculated  from  the  above 
imple,  using  the  binomial  distribution  is: 

Point  estimate: 

R»  1  - 1/10*0.90 

Lower  limit  (for  defectives) : 


a  *  1  (number  of  defective  systems) 
n  «  10  (number  of  systems) 


Degrees  of  freedom 


=2  (10  -1 +1)  =  20 
Vj  =  2  X  1  =  2 

Fi  =  19.4  (from  Appendix  3E  Table  2B) 

p^  =  - 1 -  =  0.0051 

1  -HO  X  19.4 

Upper  Limit  (for  defectives) 

(a  -i- 1)  Fo 

P2=  - - ^ - 

(n  -  a)  (a  1)  F2) 

When; 

a  =  1  (number  of  defective  systems) 

n  =  10  (number  of  systems) 

Degrees  of  freedom: 

Vi  =  2(1-H)  =  4 

V2=  2  (10-1)  =  18 

F2  =  2.93  (from  Appendix  3E  table  2A) 

P2  =  2  x_2.93_  ^  Q  3gQ 

9  +  2  X  2.93 

Confidence  interval: 

1  =  (0.396)  =  0.604  <  R  <  1  -  (0.0051)  =  0.9949 


'I 
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.  (2)  A  system's  reliability  was  calculated  from  a  total  of  200  test  specimens  and  found 

to  be  R  =  0.995.  Tne  95  percent  one  sided  lower  confidence  limit  is: 

Upper  Limit  (for  defectives): 

(a+  1)  F2 

^  (n  -  a)  +  (a  +  1 )  F2 

When: 

a  =  0.005  X  200  =  1  (average  number  of  defectives) 
n  =  200 


Degrees  of  freedom 

Vi  =2(1  +1)  =  4 

V2  =  2{200-1)  =  398j%?«> 

F2  =  2.37  (From  Appendix  3E  Table  2A) 

P2=  - -  ^  -  =0.0233 

(200-1) +2x2.37 


Lower  confidence  limit: 


R  *  0.995  ■  0.023  =  0.972 
B.  Factorial  Experiment 


This  example  demonstrates  how  factorially  designed  environmental  experiments  can 
be  used  in  combination  with  tests  of  increased  severity.  A  simple  three-treatment-experiment 
example  is  given  below.  The  treatments  used  in  this  e.xample  are  identified  and  defined  as  follows: 

Identification  Treatment  - 

A  Transportation  vibration 

B  Flight  shock 

C  High  temperature 
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By  using  the  letters  (a,  b,  and  c)  and  symbol  (1 )  to  represent  the  results  obtained  from  testing  the 
eight  items,  it  can  be  shown  symbolically  that  the  treatment  effects  can  be  independently  deter¬ 
mined,  using  the  total  number  of  items  in  the  entire  experiment  for  each  treatment  ;is  follov/s:  ■ 

Effect  of  treatment  A 

a■^(a  +  b)  +  (a  +  c)-^(a-♦■b+c)  — 

{(1)  +  b  +  c  +  (b  +c)]  =  4A 
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Effect  of  treatment  B 


b  +  (b  +  c)+(a  +  b)  +  {a  +  b  +  c)- 
[(1)  +c  +  a  +  (a  +  c)]  =  4B 

Effect  of  treatment  C 

c  +  (b  +  c)  +  (a  +  c)  +  (a  +  b  +  c)  - 
[(1)  +b  +  a  +  (a  +  b)j  =  4C 

One-fourth  of  these  differen  jes  equals  the  average  effect  of  the  respective  treatments.  From  the 
above  equations  it  can  be  seen  that  the  results  obtained  from  the  eight  items  have  been  used  three 
times  —  once  for  each  treatment.  This  procedure  produces  an  effective  sample  size  equal  to  3  x  8, 
or  24  items.  Each  treatment  effect  has  been  determined  independently  of  the  others  with  a  preci¬ 
sion  equal  to  the  total  number  of  items  used  in  the  experiment. 

The  above  three-factor  factorial  can  be  used  as  an  example  of  a  fractional  factorial  design 
as  follows: 


B^  B2 


C-i  -  b  a 

C2  c  '  •  (a  +  b  +  c) 

A  minimum  of  four  items  is  required  in  this  design.  As  before,  the  separate  effects  can  be  deter¬ 
mined  by  a  process  of  summation  and  subtraction  as  follows: 

Effect  of  treatment  A 

a (a  +  b  +  c)  -  (b  +  c)  =  2A 

Effect  of  treatment  B 

b  (a  +  b  +  c)  -  (a  c)  =  2B 

Effect  of  treatment  C 

c  (a -f  b c)  -  (a  +  b)  *  2C 

One-half  of  these  differences  equals  the  average  effect  of  the  respective  treatments. 
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When  there  is  only  one  item  available  for  each  treatment  combination,  and  only  success 
and  failure  data  are  available,  the  usual  analysis  of  variance  cannot  be  used  but  the  remaining  ad¬ 
vantages  of  the  factorial  design  (given  previously)  ^ill  pertain.  The  above  differences,  which  will 
be  binomial  proportions  in  this  case,  can  be  compared  by  the  Fisher  exact  method  for  2  x  2  contin¬ 
gency  tables  (ref.  7)  to, determine  the  treatment  effects.  A  very  convenient  set  of  tables  for  this 
purpose  can  be  found  in  ref.  8,*  which  contains  tables  of  minimum  contrasts  based  on  Fisher's 
exact  method. 


a.  Sample  calculations.  The  full  three-factor-experiment  used  above  might  give  the 
following  typical  set  of  results,  when  the  figure  "one"  is  entered  as  a  "failure"  and  a  "zero"  is 
entered  as  a  "success."  It  is  assumed  that  a  knowledge  of  the  item  being  tested  has  led  to  the  deci¬ 
sion  that  transportation  vibration,  flight  shock,  and  high  temperature  in  that  order,  are  the  three 
environmental  conditions  most  likelv  to  affect  the  important  functioning  characteristic  of  this 
item;  this  characteristic  is  waterproofness.  The  treatment  procedure  and  worksheet  (to  record  rer 
suits)  for  this  experiment  would  be  the  following  two-entry  table.  A  plus  mark  in  the  item  column 
means  that  the  item  received  the  corresponding  treatment,  while  a  "blank"  means  that  the  item  did 
not  receive  the  treatment. 


Tre^ment  procedure 


Order  of 

Treatment 

14 

5-8 

9-12 

Item  Number 
13-16  17-20 

21-24 

25-28 

29-32 

Transportation  vibration  (A) 

+ 

-t- 

+ 

Flight  shock  (B) 

+ 

-► 

+ 

+ 

High  temperature  (C) 

+ 

+ 

+ 

■f 

Results:  Replication  1 

1 

i 

B 

1 

B 

0 

1 

1 

2 

0 

0 

B 

1 

1 

1 

'  3'  • 

Q 

1 

0 

1 

1 

1 

4 

1 

B 

1 

EBI 

0 

1 

1 

Totals 

2 

B 

D 

3 

0 

2 

4 

4 

The  results  of  one  complete  replication  should  be  obtained  under  a  single  set  of  controlled  condi¬ 
tions  (e.g.,  in  the  same  day,  same  operators,  same  instruments,  etc.),  before  going  to  the  next 
replication.  This  wilt  make  it  possible  to  determine  whether  conditions  changed  significantly  during 
the  experiment. 


•"See  also  Appendix  3A" 


Placing  these  results  in  the  usual  factorial  matrix,  the  following  table  would  be  obtained; 


Al 


Aj 


In  preparation  for  analyzing  these  results,  the  usual  summing  process  would  give  the  following 


series  of  two-factor  tables; 

Summing  over  A: 

Zl 

B2  ~ 

Row  Totals 

Cl 

2 

5 

7 

C2 

4 

6 

10 

Column  totals 

6 

11 

17 
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Summing  over  B: 


Al 

A2 

Row  Totals 

Cl  4 

3 

7 

C2  _2_ 

8 

10 

Column 

Totals  6 

11 

17 

Summing  Over  C: 

■ 

A2 

Row  Totals 

Bl  2 

■4 

6 

1 

1 

m 

7 

11 

Column 

Totals  6 

11 

17 

Note  that  approximately  50  percent  (17/32)  failures  were  obtained.  This  is  the  condition  under 
which  the  greatest  resolution  of  effects  is  obtained.  Each  one  of  the  marginal  totals  is  the  sum  of 
16  observations.  The  results  can  now  be  analyzed  and  interpreted  as  follows: 


Source 

Effects 

Test  of  Significance' 

Main  Effects 

Transportation  vibration  (A) 

6/16  vs  11/16 

Non-significant 

Flight  shock  (B) 

6/16  vs  11/16 

Non-significant 

High  temperature  (C) 

7/16  vs  10/16 

Non-significant 

Replication 

,  1.4/8 

■ 

Non-aignif  leant. 

2.  3/3 

' 

3.  5/8 

4.  5/8 

*From  Appendix  3A  Table  1. 
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Source 

Effects 

Test  of  Significance* 

Interactions 

Ax  B 

8/16  vs  9/16 

Non-significant 

Ax  C 

5/16  vs  12/16 

Significant 

BxC 

8/16  vs  9/16 

Non-significant 

A  X  B  X  C 

6/16  vs  11/16 

Non-significant 

*From  Appendix  3A  Table  1. 

b.  Interpretation  (when  the  above  order  is  used) 

( 1 )  The  replication  effect  isinot  significant.  This  means  that  the  conditions  of 
the  experiment  did  not  change  significantly  from  the  beginning  to  the  end.  Therefore,  the  results 
can  be  accepted  as  valid  from  this  standpoint. 

(2)  None  of  the  effects  is  significant  except  the  A  x  C  interaction.  This  means 
that  the  combination  of  transportation  vibration  and  high  temperature  treatments  has  caused 

a  larger  difference  in  the  number  of  failures  than  would  be  expected  due  to  chance  variations  alone. 

(3)  None  of  the  treatments  taken  alone  is  significant,  although  the  flight  shock  and 
transportation  vibration  effects  approach  significance.  These  results  suggest  the  need  for  additional 
flight-shock  and  transportation  vibration  tests  if  these  treatments  are  considered  important  from  an 
engineering  point  of  view. 

These  results  show  clearly  that  the  combination  of  transportation  vibration  and 
high  temperature  is  the  most  severe  condition.  From  this,  reliability  should  be  defined  in  terms 
of  waterproofness  after  transportation  vibration  and  high  temperature.  If  this  reliability  is 
acceptable,  the  waterproofness  reliabilities  under  all  of  the  other  conditions  used  will  .also  be 
:.oceptable. 

C.  Tests  of  Increased  Severity 

a.  Bruceton  method  (ref.  3).  The  results  from  the  factorial  experiment  described 
above  show  that  the  Bruceton  "up-and-down"  procedure  can  be  conducted'  by  varying  the  severity 
(g-fofce  level)  of  the  transportation  vibration  treatment  and  using  the  same  high  temperature  (with¬ 
out  variation)  as  that  used  in  the  factorial  experiment.  This  can  be  done  since  the  high  temperature 
main  effect  (difference  in  the  number  of  failures  between  the  presence  and  absence  of  this  treatment) 
is  not  significant.  Assuming  that  the  average  g-force  expected  in  use  is  4  g's  with  a  standard  deviation 
of  2  g's,  then  ‘jsing  increments  of  2  g's  and  starting  at  6  g's.  apply  the  vibration  and  temperature 
treatments  and  conduct  the  waterproofness  test  on  one  new,  unused  item.  If  the  item  does  not 
fail,  increase  the  g-level  one  increment  and  again  test  one  new,  unused  item.  Continue  this  process 
of  increasing  the  g-level  one  increment  at  a  time  and  testing  ofie  new,  unused  item  at  each  g-level 
until  the  first  failure  is  obtained.  Then  reverse, the  process  by  decreasing  the  g-level  one  increment 
•  t  a  time  and  testing  one  new,  unused  item  at  each  g-level  until  an  item  successfully  passes  the 


g-level 


waterproofness  test.  Repeat  the  process  of  increasing  the  g-level  to  failure  and  decreasing  the  g-level 
to  success,  until  at  least  12  items  have  been  made  to  fail  in  this  manner. 

Ordinarily  the  Bruceton  method  would  not  be  used  for  this  test.  Since  the  result  of 
each  test  must  be  known  before  the  next  test  can  be  run,  this  method  would  consume  far  too  much 
time.  It  is  used  here  for  demonstration  purposes  only.  In  practice  the  Two-stimuli  method  should 
be  used  for  a  test  of  this  kind,  since  several  of  the  tests  could  be  conducted  concurrently  with  a 
considerable  saving  of  time. 

Record  the  results  in  graphic  form  for  convenience  and  count  the  number  of  failures 
obtained  at  each  g-le'/el.  The  following  can  be  used  as  an  example  of  the  type  of  observed  data  that 
could  be  obtained: 


Diagram  Number  I  Distribution  of  fail>  _>.‘i 


Calculate  the  average  (X)  and  standard  delation  (s)  of  the  failure  rate  as  follows  (ref.  3): 
Where: 


X  »  k  X  =  k 


X  *  o  ,x  *  o 

k  «  Number  of  g-levels  over  which  the  failures  aredistributed. 
f  *  Observed  frequency  of  failure. 
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X  =  Code  numbers  used  for  ease  of  calculation. 

X  =  ,yl  +d{A/N  -  1/2) 

S  =  1.62d  I  +  029 

n2 


Where: 


=  Lowest  level  at  which  a  failure  is  obtained, 
d  =  2  g's.  —  the  increment  used. 

N  =  Total  number  of  failures. 

This  formula  for  the  standard  deviation  is  an  approximation  which  is  quite  accurate  when 
exceeds  0.3. 


(NB  -  a2) 


N 


Using  these  formulas  and  the  observed  data,  the  average  and  standard  deviation  for  the 
above  example  can  be  calculated  as  follows: 


_f_ 

1 

2 

5 

3 

1 


X 

4 

3 

2 

1 

0 


fx 

4 

6 

10 

3 

0 


N  =  12 


A*23 


Jxi 

16 

18 

20 

3 

0 


B»57 


X2  *  14  +  2(2  J/12  •  1/2)  *  16.8  g's 


S2=  1.62x2 


12  x  57 -(23) 
(12)2 


+  0.029 


•  3.OT  g's 


The  cumulative  frequency  of  the  observed  failure  distrilxition  plotted  on  linear  probabi* 
lity  paper  closely  approximates  a  straight  line.  From  this  it  can  be  concluded  that  the  assumption  of 
normality  is  sufficiently  valid  for  use  as  a  basis  to  predict  the  expected  reiiability-in-use. 
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Therefore,  the  point  estimate  for  the  (waterproofness)  reliabiiity-in-use  can  be 
calculated  as  follows: 

A=1-P 

Where: 

P  *  The  probability  of  failure-in-use. 

The  probability  of  failure-in-use  can  be  measured  by  the  area  under  the  normal 
curve  associated  with  the  Z-value  calculated  as  follows: 

^  _  (Xt  -  Xg)  -  (M^  -  Mg) 
ff  1  +  02 

When:  ^X2  a  failure  is  obtained. 

Where: 

Xi  -  Any  stress  value. 

X2  =  Any  strength  value. 

Ml-  True  mean  of  the  stress  distribution: 

M2*  True  mean  of  the  strength  distribution. 

2 

o  ^  *  True  variance  of  the  stress  distribution. 

2 

02®  True  variance  of  the  strength  distribution. 

M2 -Ml 

*  Safety  margin. 

Ml 

The  relation  between  the  safety  margin  and  a  measure  of  probability  is  shown  above. 

If  the  product  of  the  safety  margiri  and  the  average  stress  in  use  is  divided  by  1  +  0  2  ' 

we  have  a  measure  of  probability  —  the  standard  deviate. 


•  ‘  '/ 

.  / 


Graphically,  the  relationship  between  the  test  conditions  and  use  condition  can  be 
depicted  as  follows; 

Diagram  Number  II 


Use  condition  Test  condition 

Stress  Strength 


X,  Xj  X,  X2 


Where: 

The  hotizontal  axis  represents  the  g-forces  increasing  to  the  right.  The  bell  shaped 
curve  represents  the  distribution  of  g-forces  under  the  use  condition  (the  stress  curve). 

The  S-shaped  curve  represents  the  distribution  of  failures  under  the  test  condition 
obtained  by  the  Bruceton  method  (the  strength  curve). 

When: 

Xj  =  4  g's  -  an  estimate  of  the  true  average  stress. 

s-i  =  2g's, -an  estimate  of  ff-i  the  true  standard  deviation  of  the  stress. 

X2  =  16.8  g's  -  an  estimate  of  M-]  the  true  average  strength  (the  50  percent  point  on 

the  strength  curve.) 

$2  *  3.48  g's  -  an  estimate  of  y2.  the  true  standard  deviatiort  of  the  strength. 

Xi  *  any  stress  value. 

X2  =  any  strength  value. 

From  the  above,  the  avenge  (point  estimate)  reliability-in-use  cwt  be  calcuiated  »  follows: 
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From  Appendix  3G  the  probability  of  a  failure-in-use  associated  with  this  T-value  is:  <  0.00090. 
Reliability  Point  Estimate: 

ft  >1-0.00090  >  0.99910 

The  lower  confidence  limit  for  the  one  sided  95  percent  confidence  level  can  be  calculated  as  follows: 
The  95  percent  single  sided  lower  confidence  limit  of  the  average  strength: 

■^2  ■  / -  (see  ret.  3) 

V  "2 

Where: 


X2  =  16.8  -  the  observed  average  strength. 

t  =  1 .80  —  the  t-value  associated  with  the  single  sided  95  percent  confidence  level 

and  eleven  (n2-1)  degrees  of  freedom  found  in  Appendix  3F. 

$2  =  3.58  -  the  standard  deviation  of  the  strength. 

n2  =  12  -  the  sample  size  used  to  determine  the  strength. 

Then  the  95  percent  single  sided  lower  confidence  limit  for  the  strength  is: 

16.8  -  (1-80)  (3.58)  =  14.94 

The  lower  bound  of  the  reliability-in-use  can  be  calculated  as  follows: 

14.94-4.0 

^3.58)2  +  (2)2 

T2  >  2.67 

The  probability  of  a  failure-in-use  associated  with  this  T-vaiue  (appendix  3G)  is: 

,  ft<0.0038 

The  lower  bound  of  the  reliability-in-use  is: 

R>1 -0,0038  >0.9962 

These  values  are  the  predicted  reliabilities-in-use.  They  have  been  demonstrated  with  a 
total  of  62  items  (32  in  the  factorial  experiment  and  30  in  the  Bruceton  up-and-down  method).  To 
demonstrate  this  reliability  by  doing  all  of  the  testing  at  the  use  condition,  would  require  that  786 
items  be  tested  without  a  single  failure. 


Two  stimuli  method.  The  results  of  the  factorial  experiment  described  above  can 
also  be  used  to  exemplify  this  method  of  predicting  reliability-in-use.  Beginning  at  one  irtcrement 
(one  standard  deviation)  above  the  average  use-condition,  the  g-level  can  be  increased  one  increment 
at  a  time  (as  in  the  Bruceton  method)  until  the  first  failure  is  obtained.  The  prdportions  of  failures 
at  this  point  and  at  a  point  three  increments  above  this  point  are  as  follows: 

Proportions 

g-level  of  failures 

12.0  1/10 

18.0  6/10 

This  method  (under  these  conditions)  required  a  total  of  23  test  specimens  —  3.  before  obtaining 
the  first  failure  and  10  at  each  of  the  two  points  on  the  curve. 

_  Calculate  ^e  average  (H)  and  the  standard  deviation  (S)  of  the  failure  rate  as  follows 
(ref.  10):  H  =  +d  (H)' 

S  =  dS^ 

Where: 

X-|  =  12  g's  the  weaker  stimulus. 

Pi  =  0.10,  the  proportion  of  failures  at  12  g's. 

P2  =  0.60,  the  proportion  of  failures  at  18  g's. 

d  =  6  g's  (18  —  12  g's)  the  increment  used. 

H'  •  0.8350,  the  factor  associated  with  pi  and  P2  in  table  II  of  ref.  10  for 

calculating  the  average. 

»  0.651 5,  the  factor  associated  with  pi  and  P2  in  table  II  of  ref.  10  for 
calculating  the  standard  deviation. 

H  *  Average  (50  percent  point)  of  the  failure  distrilwtion  (strength)  curve. 

S  «  Standard  deviation  of  the  failure  distribution  (strength)  curve. 

When: 

H  *  12.0  +  6.0  (0.8350)  «  17.0  g'^. 

S  »  (0.6516)  *3.9  g's. 


These  same  values  can  be  obtained  graphically  by  simply  plotting  the  proportion  of 
failures  versus  the  corresponding  g-forces  on  linear  probability  paper.  The  average  is  the  g-force 
corresponding  to  the  50  percent  point,  and  the  standard  deviation  is  the  slope  of  the  line  thru  the 
two  points,  or  is  the  difference  between  the  g-forces  corresponding  to  the  16  and  50  percent 
points. 

Using  these  values  for  the  average  and  standard  deviation,  the  point  estimate  and  lower 
confidence  limit  for  the  (waterproofness)  reliability-in-use  can  be  calculated  as  in  the  examples  for 
the  Bruceton  method. 
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GLOSSARY  OF  TERMS 


Attribute 


A  qualitative  characteristic  (such  as  acceptable  or  rejectionable,  success  or  failure, 
rusted  or  not  rusted,  wet  or  dry,  black  or  white,  miss  or  h't),  which  can  have  two  or  more  categories. 

Attribute  data 

Data  denoting  a  qualitative  characteristic.  This  type  of  data  can  have  only  discrete 
values  and  is  derived  by  counting  the  number  of  times  each  category  occurs,  such  as,  four  failures 
and  six  successes. 

Best  Estimate 


An  estimator  is  said  to  give  the  "best  estimate"  of  the  true  population  parameter  if  it 
complies  with  the  following  requirements  which  are  taken  as  the  definition  of  the  word  "best": 

A.  The  average  of  all  possible  values  of  the  estimator  equals  the  true  population 

parameter. 

B.  In  any  particular  case  the  delation  of  the  estimator  from  the  true  population 
parameter  is  less  than  any  other  possible  estimator. 

Binomial  data 

Attribute  data  that  has  only  two  categories  or  only  two  possible  outcomes  such  as 
success  and  failure. 

Blocking 

In  experimental  design,  a  block  is  a  homogeneous  group  of  items,  all  treated  under 
controlled  conditions  such  as  by  the  same  operator,  the  same  calibration  of  the  measuring  instru¬ 
ment,  or  the  same  short  period  of  time.  The  purpose  of  blocking  is  to  reduce  the  effect  of  the  hetero¬ 
geneity  of  material  and  changing  conditions  by  dividing  the  experirnent  into  rational  subdivisions. 

Confidence  interval 


The  range  of  values  within  which  the  true  population  parameter  (mean  or  standard  devia¬ 
tion)  is  expected  to  lie.  The  confidence  level  associated  with  this  interval  is  a  probability  statement 
expressing  the  proportion  of  the  time  the  true  value  is  expected  to  be  withiri  the  ifrterval. 


Confidence  level 


The  confidence  level  is  the  probability  of  being  right  in  our  predictions  or  conclusions. 
This  value  is  equal  to  one  minus  the  error  of  the  first  kind.  The  magnitude  of  this  error  that  can  be 
tolerated  should  be  established  during  the  planning  stage  of  the  experiment  (prior  to  data  collecting) 
based  on  the  consequences  of  being  wrong  and  thereby  establish  the  confidence  level. 

Confounding 

When  certain  comparisons  can  be  made  only  for  treatmenis  in  combination  and  not  for 
separate  treatments,  those  treatment  effects  are  said  to  be  confounded.  Conclusions  drawn  about 
the  separate  effects  in  this  case  will  be  ambiguous.  Confounding  is  often  a  deliberate  feature  of 
the  experimental  design  but  may  arise  from  inadvertent  imperfections. 

Criterion 

The  measu.  able  characteristic  used  to  evaluate  the  treatment  effects.  Criteria  can  also 
be  considered  as  the  dependent  variables  used  as  a  standard  of  reference  to  distinguish  between  the 
independent  variable  effects.  Velocity,  functioning  time,  voltage,  rate  of  detonation,  etc.,  can  be 
criteria. 

Degrees  of  freedom 

The  number  of  degrees  of  freedom  is  equal  to  the  number  of  independent  observations 
minus  the  number  of  parameters  (such  as  the  mean)  estimated.  That  is,  degrees  of  freedom  usually 
equal  the  sample  size  minus  one.  In  computing  the  variance  for  example,  only  (n-1 )  of  the  devia¬ 
tions  from  the  mean  can  be  independent.  The  nth  deviation  has  to  be  restricted  in  order  to  make 
the  sum  of  all  “n"  deviation  total  zero. 

Effect 

In  statistics  the  meaning  of  the  word  effect  is  synonomou^  with  the  word  difference. 

A  treatment  effect  is  the  difference  caused  by  the  treatment,  such  as  1  he  difference  in  the  measured 
results  before  and  after  the  treatment. 

Efficiency 

An  estimator  or  an  experimental  design  is  said  to  be  effici  unt  if  a  given  precision  can  be 
obtained  with  a  smaller  sample  size  of  with  less  time  and  cost. 

Error 

Chance  variations  are  considered  errors  in  statistics.  Devic  tions  from  the  expected  value, 
due  to  chance,  form  the  familiar  bell  shaped  normal  curve.  This  is  sometimes  called  the  normal 
curve  of  error.  Error  in  the  statistical  sense  does  not  imply  that  a  mistake  has  been  made. 
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Error  mean  square 


The  error  mean  square  is  the  variance  and  is  also  the  square  of  the  standard  deviat'^  t. 

It  is  calculated  by  finding  the  sum  of  the  squares  of  the  deviations  of  the  individual  sample  values 
from  their  mean  and  dividing  by  the  number  of  degrees  of  freedom. 

Error  of  estimate 

The  difference  between  an  estimated  value  and  the  true  value. 

Error  of  first  kind 

If,  as  a  result  of  a  statistical  test,  the  null  hypothesis  is  rejected  when  it  is  true,  then  it 
is  said  that  an  error  of  the  first  kind  is  committed.  This  type  of  error  is  also  called: 

a.  The  alpha  error. 

b.  The  produce's  risk. 

c.  The  risk  of  rejecting  good  material. 

The  magnitude  of  this  error  should  be  established  from  the  consequences  of  being  wrong  and  con¬ 
trolled  at  that  level  by  calculating  the  required  sample  size. 

Error  of  observation 

An  error  of  observation  arises  from  imperfections  in  the  method  of  measurement  or 
from  human  mistakes. 

Error  of  second  kind 

If,  as  a  result  of  a  statistical  test,  the  null  hypothesis  is  accepted  when  it  is  false,  then  it 
is  said  that  an  error  of  the  second  kind  is  committed.  This  type  of  error  is  also  called: 

a.  The  beta  error. 

b.  The  consumer's  risk. 

c.  The  risk  of  accepting  poor  material. 

After  the  error  of  the  first  kind  has  been  established,  the  error  of  the  second  kind  is  controlled  by  the 
sample  size..  This  error  is  very  important  in  Ordnance  work  because  it  controls  the  probability  of 
accepting  poor  material. 

Estimate 

An  estimate  is  the  particular  value  obtained  by  an  estimator  in  a  given  set  of  circumstances. 
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Estimator 


An  estimator  is  the  method  of  estimating  a  constant  of  a  parent  population.  It  is  usually 
expressed  as  a  function  of  sample  values  (such  as  the  average)  and  therefore  is  a  variable. 

Experimental  error 

Experimental  error  is  the  chance  vjriation  to  be  expected  under  controlled  conditions. 

It  is  not  the  result  of  mistakes  in  experimental  design  or  avoidable  imperfections  in  technique. 

Experimental  unit 

An  experirhental  unit  is  the  smallest  subdivision  of  the  experimental  material  that  can 
receive  different,  treatments  in  the  actual  experiment.  It  is  also  known  as  a  test  specimen. 

Factor 

A  factor  is  a  quantity  under  examination  (in  an  experiment)  as  a  possible  cause  of 
variation.  In  practice  tne  terms  factor,  treatment,  and  variable  are  loosely  used  interchangeably  in 
this  sense. 

Factorial  experiment 

An  experiment  which  investigates  all  of  the  possible  treatment  combinations  that  may 
be  formed  from  the  factor  versions  under  investigation. 

Fractional  factorial  experiment 

This  is  a  fractional  part  of  a  factorial  experiment.  When  three  or  more  factors  are  used 
in  a  factorial  experiment  only  a  fractional  part  (1/2, 1/4, 1/8)  of  the  total  number  of  possible  com¬ 
binations  need  be  used  if  certain  of  the  interactions  can  be  considered  negligible.  This  device  can 
be  resorted  tp  without  loss  of  efficiency  when  the  number  of  factors  to  be  investigated  makes  the 
full  factorial  so  large  that  it  is  impractical  to  use. 

Hypothesis 

A  hypothesis  is  a  contention  based  on  preliminary  observation  of  what  appears  to  be 
fact.  It  is  the  prediction  derived  frorh  past  experience  that  is  to  be  verified  or  rejected  by  experimen¬ 
tation.  Natural  "laws"  are  hypothesis  which  have  been  subjected  to  various  tests  and  have  been 
accepted.  In  statistical  tests  two  hypothesis  are  used: 

a.  The  null  hypothesis  is  a  hypothesis  of  "no  difference.”  This  is  the  assumption 
that  the  contemplated  changes  wiil  make  no  difference.  This  hypothesis  is  fonnulated  for  the 
express  purpose  of  being  rejected  in  the  process  of  controlling  the  error  of  the  first  kind. 

b.  The  alternative  hypothesis  is  the  operational  statement  of  the  experimenter's 
prediction.  It  is  the  positive  statement  that  the  changes  will  make  a  detectable  difference.  If  the 
resultant  data  reject  the  null  hypothesis  the  alternative  hypothesis  will  be  accepted. 


79 


Independence 


Measurements  are  independent  if  the  taking  of  one  does  not  effect  any  of  the  others.  That 
is,  there  is  no  correlation  among  them.  Treatment  effects  are  said  to  be  independent  if,  in  an  ortho¬ 
gonal  experiment,  there  is  no  interaction. 

Interaction 


Interaction  is  a  measure  of  the  extent  to  which  the  effect  of  changing  the  level  of  one 
factor  depends  on  the  level  of  another  factor.  Interaction  is  said  to  be  present  when  a  certain  parti¬ 
cular  combination  of  treatn  ents  produces  unusual  (unpredictable)  results.  Only  factorial  type  ex¬ 
periments  can  measure  interaction  effects. 

Levels 

The  level  of  a  factor  (or  treatment)  denotes  the  intensity  with  which  it  is  used  or  applied. 
Levels  of  a  factor  may  be  either  qualitative,  such  as  presence  and  absence  of  the  treatment,  or  the 
levels  may  be  quantitative,  such  as  the  number  of  volts  applied. 

Main  effects 

A  main  effect  is  the  average  difference(s)  bet  een  (or  among)  the  levels  of  a  variable  o' 
treatment  when  averaged  over  all  of  the  other  treatmens  which  form  a  part  of  the  same  orthogonal 
experiment.  If  significant  interaction  effects  are  present,  care  must  be  taken  in  stating  the  main 
effects.  In  such  cases  the  level  of  the  interacting  treatment  associated  with  the  stated  main  effect 
must  also  be  stated. 

Normal  distribution 


The  physical  appearance  of  a  normal  distribution  is  the  familiar  bell-shaped  curve. 

A  normal  distribution  can  not  be  represented  by  only  a  single  curve.  It  is  actually  a  family  of 
curves  whose  areas  under  them  are  distributed  in  a  very  specific  manner.  A  normal  curve  has  the 
following  properties: 

a.  Continuous. 

b.  Symmetrical. 

c.  Unimodal. 

d.  Asymptotic  to  x-axis. 

e.  Completely  described  by  the  mean  and  standard  deviation. 

f.  The  distance  between  the  ordinate  of  the  mean  and  the  inflection  point  on  either 
half  of  the  curve  is  equal  to  the  standard  deviation. 

g.  The  area  included  between  the  ordinates  drawn  thru  the  two  inflection  points  equals 
68.27  percent  of  the  total  area  under  the  curve. 
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Parameter 


A  parameter  is  a  quantity  such  as  the  mean  or  standard  deviation,  calculated  from  a  popula¬ 
tion.  The  populatioi'  mean  and  standard  deviation  are  parametei's  and  as  such  are  constants.  In  actual 
practice  parameters  are  usually  unknown. 

Point  estimate 


This  is  one  of  the  two  principal  bases  of  estimation  in  statistical  analysis.  Point  estimation 
endeavors  to  give  the  best  single  estimated  value  of  a  parameter,  as  compared  with  interval  estimation 
which  specifies  a  range  of  values.  Since  a  point  estimate  includes  an  error  of  measurement,  the 
difference  between  a  point  and  an  interval  is  not  always  clear.  In  interpretation  they  often  amount 
to  the  same  thing. 

Population 

A  population  is  any  set  of  individuals  or  objects  having  some  common  observable  character¬ 
istic.  The  term  population  may  refer  either  to  the  individuals  measured  or  to  the  measurements  them¬ 
selves.  A  population  is  usually  considered  to  consist  of  an  infinite  number  of  individuals.  The  curve 
of  the  normal  distribution  graptiically  represents  a  population. 

Precision 

Precision  is  a  property  of  the  measuring  system  and  refers  to  the  ability  of  the  system  to 
reproduce  previous  results.  Precision  should  be  distinguished  from  accuracy  which  refers  to  the  mag¬ 
nitude  of  the  difference  between  the  observed  values  and  the  true  value  o*  the  characteristic  being 
measu''ed.  Precision  should  also  be  distinguished  from  the  sensitivity  of  the  measuring  system  which 
is  the  ability  of  the  system  to  detect  actual  variations  that  Occur.  An  insensitive  system  will  give 
the  false  impression  of  high  precision  (small  variation). 

Probability 

In  applied  statistics  probability  can  be  considered  a  relative  frequency  or  a  simple  proportion. 
Probability  is  the  relative  frequency  of  events  in  a  veiy  long  sequence  of  trials.  For  example,  the 
probability  of  a  particular  coin  falling  heads  up  is  the  ratio  of  the  number  of  heads  occurring  to  the 
total  number  of  trials  in  a  sequence  of  trials.  In  somewhat  similar  fashion  a  normal  distribution  can  be 
formed  from  a  very  large  body  of  data.  As  a  result,  the  area  under  the  normal  cuive  is  used  as  a 
measure  of  probability. 

Randomization 

The  word  randomization  has  a  very  special  technical  meaning  in  statistics.  It  means  rearranging 
a  group  of  items  or  numbers  into  a  series  or  sequence  having  no  recognizable  pattern.  The  essential 
feature  of  randomization  is  that  is  should  be  an  objective  impersonal  procedure.  Whether  or  not. 
proper  randomization  has  b^n  obtained  should  not  be  determined  by  an  examination  of  the  indivi¬ 
duals  randbmized,  but  rather  by  examining  the  properties  of  the  procedure  by  which  randomization  was 
accomplished.  The  objectives  of  randomizing  are  as  follows: 

a.  To  give  the  laws  of  chance  free  play, 

b.  To  give  every  possible  sequence  an  eqOaily  likely  chance  of  occurring. 


c.  To  assure  that  adjacent  individuals  are  completely  independent. 

d.  To  remove  biases  of  any  kind. 

e.  To  prevent  systematic  error. 

Reliability 

In  missile  technology  reliability  is  the  probability  of  success  in  performing  a  specified 
function,  under  a  specified  condition,  for  a  specified  length  of  time,  and  after  a  specified  period  of 
time.  From  this  it  is  clear  that  any  particular  component  can  have  many  reliability  values 
simultaneously-one  for  every  possible  combination  of  function,  condition,  and  time. 

Replication 


Replication  is  the  performance  of  an  experiment  in  its  entirety  one  or  more  times.  Two 
or  more  replications  are  usually  for  the  purpose  of  obtaining  an  independent  measure  of  the  sampling 
or  experimental  error  Replication  should  be  distinguished  from  repetition,  in  that,  replication  means 
repetition  carried  out  under  the  same  conditions,  at  the  same  time,  by  the  same  operators,  with  the 
same  instruments,  and  with  the  same  homogeneous  material.  A  replication  is  sometimes  considered 
a  block. 

S  .mple 

Any  finite  subset  of  a  population  is  a  sample  of  that  population. 

Sample  size 


The  sample  size  is  the  number  of  items  or  individual  values  in  the  sample.  , 
Standard  deviation 


a.  Definition.  The  standard  deviation  is  a  measure  of  the  variation  among  the  individual 
values  in  a  sample  and  a  measure  of  the  dispersion  among  the  individual  values  in  a  frequency  dis¬ 
tribution.  It  is  the  most  efficient  measure  of  precision  and  is  designated  by  the  lower  case  letter 
"s".  This  value  is  large  for  large  variations  (poor  precision)  and  small  for  small  variations  (good 
prTCision).  Although  the  word  "error",  is  sometimes  used  in  referring  to  the  standartf  deviation 
or  its  square  (the  variance)  these  values  can  measure  only  precision  in  the  true  sense  of  the  word. 
They  do  not  measure, accuracy. 

If  the  term  standard  deviation  is  stated  alone  and  not  modified  or  otherwise  qualified  by 
an  accompanying  word  or  phrase,  it  is  understood  that  the  term  refers  to  the  standard  deviation  of 
the  individual  sample  measurements.  This  value  can  be  calculated  from,  the  sample  data  and  is  a 
variable. 


There  are  two  additional  kinds  of  standard  deviations: 

1 .  The  population  standard  deviation  which  is  a  constant  and  cannot  be  calculated 
from  the  sample  data.  This  value  is  designated  by  the  small  Greek  letter  sigma  and  is  usually  con¬ 
sidered  unknown  unless  a  very  large  body  of  data  is  collected  to  measure  it  or  unless  it  is  assigned 

a  value  as  in  a  specification  requirement. 

2.  The  standard  deviation  of  the  mean  is  a  measure  of  the  variation  among  several 
sample  averages.  This  value  can  be  calculated  from  sample  data  and  it  is  a  variable.  It  is  usually 
designated  by  the  lower  case  letter  "s"  with  the  subscript  X.  If  all  of  the  sample  sizps  are  equal  this 
value  can  be  calculated  by  dividing  the  standard  deviation  of  the  individual  sample  values  by  the 
square  root  of  the  number  of  individual  values  in  each  of  the  samples. 


where: 


Sample  standard  deviation  of  the  individual  values. 

This  symbol  nieans  to  add  all  of  the  "n"  quantities 
designated  by  the  paienthests.  It  is  read:  sum  from  i  =  1  to  i  =  n. 

X  =  Sample  average. 

Xj  =  Any  one  of  the  "n”  values  that  make  up  the  sample, 

n  *=  S<..  ,.,z  size  or  the  number  of  individual  values  that  make  up  the  sample. 

(n-1)  =  Number  of  degrees  of  freedom  associated  with  the  standard  deviation. 

O' 

s^  =  Sample  variance  of  the  individual  values. 


s!  f'/n  -  Sample  standard  deviation  of  the  mean  (Sj^J. 

Statistic 

A  statistic  is  a  summary  value  calculated  from  a  sample  of  values.  The  sample  mean  « 
a  statistic  and  as  such  is  a  variable,  not  a  constant 
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Statistical  significance 


A  difference  or  an  effect  is  said  to  be  statistically  significant  if  it  is  greater  than  that 
expected  due  to  chance  alone.  If  the  probability  (chance)  is  very  small  that  a  value  came  from  a 
particular  population,  the  difference  between  that  value  and  the  mean  of  the  population  is  said 
to  be  statistically  significant. 

Statistics 

The  subjecf  of  statistics  is  the  science  of  collecting,  analyzing,  and  interpreting  numerical 

data. 

Treatment 

In  experimentation,  a  treatment  is  a  stimulus  which  is  applied  in  order  to  observe  the  effect 
on  the  experimental  situation.  A  treatment  may  refer  to  a  physical  substance,  a  procedure,  or  any¬ 
thing  which  is  capable  of  controlled  application.  In  statistical  parlance  a  treatment  is  the  variable 
being  studied  or  the  experimental  condition. 

True  Value 


The  true  value  is  another  expression  for  a  population  parameter  such  as  the  population 
mean  or  standard  deviation.  The  true  value  can  also  be  the  expected  value  or  the  theoretical  value. 

Validation 


Validation  is  a  procedure  which  provides,  by  reference  to  independent  sources,  evidence 
that  an  inquiry  is  free  from  bias,  or  otherwise  conforms  to  its  declared  purpose.  In  statistics  it  is 
usually  applied  to  a  sample  investigation  with  the  object  of  showing  that  the  sample  is  reasonably 
representative  of  the  population  and  that  the  information  collected  is  accurate. 

Variabie  , 

A  variable  is  any  quantity  or  measurable  characteristic  which  varies.  More  precisely  in 
statistics  a  variable  is  any  quantity  which  can  have  any  one  of  a  specified  set  of  values. 


Variable  data 

Variable  data  is  a  term  used  to  describe  a  type  of  data  that  can  vary  on  a  continuous  scale 
from  zero  to  infinity.  Weight  in  pour,/ is,  length  in  feet,  E.M.F.  in  volts,  and  temperature  in  degrees 
are  variable  type  data. 


Variance 

Variance  is  a  measure  of  variation  in  a  sample,  or  dispersion  in  a  frequency  distribution. 
The  variance  is  equal  to  the  square  of  the  standard  deviation. 
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Table  1 

MINIMUM  CONTRASTS  95%  (TWO  SIDED)  TEST 
N  =  TOTAL  NUMBER  OF  TRIALS  IN  EACH  SAMPLE 

NOo  of  A' 3  in  Sample  (1)/No.  of  A's  in  Sample  (2) 

0/4  1/- 
0/4  1/5  2/- 
0/5  1/6  2/- 
0/5  1/6  2/7  3/- 
0/5  1/6  2/7  3/8  4/- 
0/5  1/6  2/8  3/8  4/9  5/- 
0/5  1/7  2/8  3/9  4/10  5/10  6/- 
0/5  1/7  2/8  3/9  4/10  5/11  6/11  7/- 
0/5  1/7  2/8  3/9  4/10  5/11  6/12  7/12  8/- 
0/5  1/7  2/8  3/9  4/10  5/11  6/12  7/13  8/13  9/- 
0/5  1/7  2/8  3/10  Z/U  5/12  6/12  7/13  8/U  9/U  10/- 

0/5  1/7  2/9  3/10  4/11  5/12  6/13  7/U  8/U  9/15  10/15  U/- 

0/5  1/7  2/9  3/10  4/11.  5/12  6/13  7/U  8/15  9/15  10/16  U/16  12/- 

0/5  1/7  2/9  3/10  4/11  5/12  6/13  7/U  8/15  9/16  10/16  11/17  12/17 

13/- 

0/5  1/7  2/9  3/10  4/11  5/12  6/13  7/U  8/15  9/16  10/17  11/17  12 AS 
13/18  U/- 

0/5  1/7  2/9  3/10  4/11  5/12  6/U  7/U  8/15  9/l6  10/17  11/18  12A8 
13/19  U/19  15/- 
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Table  1  (Continued) 

MINIMUM  CONTRASTS  95%  (TWO  SIDED)  TEST 
N  =  TOTAL  NUMBER  OF  TRIALS  IN  EACH  SAMPLE 

N  No.  of  A's  in  Sample  (1)/No.  of  A'e  in  Sample  (2) 

20  0/5  1/7  2/9  3/10  4/11  5/13  6/U  7/15  8/l6  9/16  10/17  11/18  12/19 

13/19  14/20  15/20  16/- 

30  0/6  1/8  2/9  3/11  4/12  5/13  6/15  7/16  8/17  9A8  10/19  16/25  17/25 

20/28  21/23  23/30  24/30  25/- 

40  0/6  1/8  2/9  3/11  4/12  5/14  6/15  7/16  8/18  9/19  10/20  23/33  24/33 

27/36  28/36  30/38  31/38  33/40  34/40  35/- 
50  0/6  1/8  2/10  3/11  4/13  5/14  6/15  7/17  8/18  9/19  10/20  11/22  29/40 

30/40  34/U  35/44  38/47  39/47  a/49  42/49  44/50  45/- 
60  0/6  1/8  2/10  3/11  4/13  5/U  6/16  7/17  8/l8  9/20  10/21  11/22  12/23 

13/24  14/26  35/47  36/47  41/52  42/52  45/55  46/55  48/57  49/57  5V59 
52/59  53/60  54/60  55/- 

70  0/6  1/8  2/10  3/11  4/13  5/U  6/16  7/17  8/18  9/20  10/21  11/22  12/23 

13/25  18/30  19/32  20/33  39/52  40/52  46/58  47/58  51/62  52/62  55/65 
56/65  58/67  59/67  61/69  62/69  63/70  64/70  65/- 
80  0/6  1/8  2/10  3/11  4/13  5/U  6/16  7/17  8/19  9/20  10/21  11/22  12/24 

13/25  14/26  15/27  16/29  23/36  24/38  43/57  44/57  52/65  53/65  57/69 
58/69  62/73  63/73  65/75  66/75  68/77  69/77  71/79  72/79  73/30  74/80 
75/- 
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Table  1  (Continued) 

MINIMUM  CONTRASTS  95%  (TWO  SIDED)  TEST 
N  =  TOTAL  NUMBER  OF  TRIALS  IN  EACH  SAMPLE 

N  No.  of  A's  in  Sample  (1)/  No,  of  A*s  In  Sample  (2) 

9C  0/6  1/8  2/10  3/11  4/13  5/U  6/l6  7/17  8/19  9/20  lC/21  11/23  12/24 

13/25  U/26  15/28  20/33  21/35  31/45  32/47  44/59  45/59  56/70  57/70 

63/76  64/76' 68/80  69/80  72/83  73/83  75/85  76/85  78/87  79/37  81/89 

82/89  83/90  84/90  85/- 

100  0/6  1/8  2/lC  3/11  4/13  ^/15  6/16  7/l7  8/19  9/20  10/21  11/23  12/24 

13/25  14/27  18/31  19/33  25/39  26/41  60/75  61/75  68/82  c9/82  74/87 

75/87  78/90  79/90  82/93  33/93  86/96  87/96  83/97  89/97  91/99  92/99 

93/100  94/100  95/- 

150  C/6  1/8  2/10  3A2  4/13  5/15  6/16  7/l8  8/19  9/20  10/22  11/23  12/24 

13/26  14/27  15/28  16/30  19/33  20/35  25/40  26/42  32/48  33/50  41/58 
42/60  91/109  92/1C9  lCl/118  102A18  109/125  110/125  116/131  117/131 
121/135  122/135  125/138  126/138  129/141  13C/U1  133/144  134/144 
136/146  137/146  139/148  14C/U3  La/149  142/U9  143/150  144/150  145/^ 

2CC  0/6  1/8  2/10  3/12  4/13  5/15  6/16  7/18  8/19  9/21  10/22  11/23  12A5 
■  13/26  14/27  15/29  18/32  19/34  22/37  23/39  27/43  23/45  33/50  34/52 
41/59  42/61  51/70  52/72  65/85  66/87  1U/D5  115A35  129/U9  130/l49 
140/159  141/159  149/167  15C/167  156/173  157/173  162/178  163A7S 
167/182  168/182  172/186  173/186  176/189  177/189  18C/192  181/192 
183/194  18Vl9^  186/196  lsrA96  109/198  190/190  191/199  193/199 
193/200  19^/200  195/- 
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Table  1  (Continued) 

MINIMUM  CONTRASTS  95%  (TWO  SIDED)  TEST 
N  =  TOTAL  NUMBER  OF  TRIALS  IN  EACH  SAMPLE 

fo.  of  A* 8  In  Sample  (1)/  No.  of  A's  in  Sample  (2) 

C/6  1/3  2/10  3/L2  4/U  5/l5  ,6/l6  7/18  8/19  9/21  10/22  11/24  12/25 
13/26  14/28  15/29  16/30  17/31  18/33  19/34  20/35  21/37  24/40  25/42 
29/46  30/48  35/53  36/55  41/60  42/62  48/68  49/70  56/77  57/79  66/88 
67/90  78/101  79/103  95/119  96/121  I8O/2O5  181/205  198/222  199/222 
211/234  212/234  222/2U  223/244  232/252  232/252  239/259  240/259 
246/265  247/265  253/271  254/271  259/276  260/276  264/280  265/280 
268/283  269/283  273/287  274/287  277/290  278/290  280/292  281/292 
283/294  284/294  286/296  287/296  289/298  290/298  291/299  292/299 
293/300  294/300  295/- 
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Table  2 

MINIMUM  CONTRASTS  99%  (TWO  SIDED)  TEST 
N  -  TOTAL  NUMEER  OF  TRIALS  IN  E/CH  SAMPLE 


N 

of  ^ 

L’'s  in' Sa"!Dle  (1)/  To,  jf  A*s  in  Sair.Dl-.  C2/ 

5 

0/3 

1/- 

6 

0/6 

1/- 

/ 

0/6 

1/7 

2/- 

8 

0/6 

1/8 

2/83/-  , 

9  . 

0/6 

1/8 

2/9  3/9  4/-  ■ 

10 

0/7 

1/8 

2/9  3/10  4/- 

11 

0/7 

1/8 

2/9  3/10  4/11  5/- 

12 

0/7 

1/8 

2/10  3/11  4/n  5/12  6/- 

13 

0/7 

1/9 

5/13  6/13  ?/- 

14 

0/7 

V'9 

6/U  7/U  8/- 

15 

C/7 

1/9 

7/15  8/15  9/- 

16 

0/7 

1/9 

2/10  3/12  4/13  5/U  6/U  8/16  9/16  30/- 

17 

0/7 

1/9 

2/11  7/16  8/16  9/17  10/17  11/- 

18 

0/7 

:/9 

2/11  8/17  9/17  10/18  11/18  12/- 

19 

0/7 

1/9 

2/11  9/13  10/18  11/19  12/19  13/'- 

20 

0/7 

1/9 

2/U  4/'13  5/15  6/16  7/16  10/19  U/19  12/20  13/20  U/- 

30 

C/G 

1/lC  2/12  3/13  4/15  10/21  16/27  17/27  18/28  19/29  2C/29 

21/30  22/30  23/* 

40  0/8  1/10  2/12  3/U  4/15  5/17 -8/20  9/22  19/32  20/32  24/36  25/36 

27/38  28/38  29/39  30/39  31/40  32/40  33/- 
0/8  1/10  2/12  3/U  4A5  5/17  6/18  7/20  9/22  10/24  27/41  28/41 
31/44  32/U  34/46  35/46  37/48  38/48  39/49  40/49  41/50  42/50  43/- 
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Table  2  (Continued) 

MINIMUM  CONTRASTS  99%  (TWO  SIDED)  TEST 
N  =  TOTAL  NUMBER  OF  TRAILS  IN  EACH  SAMPLE 

No.  of  A* 3  Id  Sample  (l)/No.  A* a  In  Sample  (Z'i  _ 

0/8  1/10  2/12  3/U  4/16  5/17  6/19  8/21  9/23  11/25  12/21 
19/34  20/36  24/40  25/41  26/a  34/49  35/49  38/52  39/52 
42/55  43/55  45/57  46/57  47/58  48/58  49/59  50/59  51/60 
52/60  53/- 

0/8  I/IO  2/12  3/14  4/16  5/17  6/19  7/20  8/22  10/24  11/26 
U/29  15/31  21/37  22/39  32/49  33/49  34/50  40/56  41/56 

45/60  46/60  49/63  50/63  52/65  53/65  55/67  56/67  57/68 

53/68  59/69  60/69  61/70  62/70  63/- 

0/8  1/10  2/12  3/U  4/16  5/18  6/19  7/21  9/23  10/25  12/27 
13/29  16/32  17/34  24/a  25/43  38/56  39/56  47/64  48/64 
52/68  53/68  56/71  57/71  60/74  61/74  63/76  64/76  65/77  66/77 
67/78  68/78  69/79  70/79  71/80  72/80  73/- 
0/8  1/10  2/12  3/U  4/16  5/18  6/l9  1/21  8/22  9/24  11/26  12/28 
15/31  16/33  19/36  20/38  28/46  29/48  43/62  44/62  53/71  54/71 

58/75  59/75  63/79  64/79  67/82  68/82  70/84  71/84  73/86  74/86 

75/87  76/87  77/88  78/88  79/89  80/89  81/90  82/90  83/- 

0/8  1/10  2/13  3/U  4/16  5/18  f>/Y)  1/21  8/22  9/24  10/25  11/27 
U/3D  15/32  18/35  19/37  23/41  24/43  33/52  34/54  47/67  48/67 

58/77  59/77  64/82  65/82,  69/86  70/86  74/90  75^0  77/92  78/92 

80/94  81/94  83/96  84/96  85/97  86/97  88/99  89/99  90/99  91/100 

92/100  93/- 
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Table  2  (Continued) 

MINIMUM  CONTRASTS  99%  (TWO  SIDED)  TEST 
N  =  TOTAL  NUMBER  OF  TRIALS  IN  EACH  SAMPLE 

J _ I _ No  of  A''s  in  Sample  (D/to  of  A  s  in  Sa^r-le  (2; _ 

150  ,  C/e  1/11  2/13  3/15  4/16  5/13  6/20  7/21  8/23  9/24  10/26 

11/27  12/29  14/31  15/33  17/35  18/37  21/40  22/42  26/46 
27/48  31/52  32/54  39/61  4C/63  51/74  52/76  75/99  76/99 
88/111  89/111  97/119  93/119  1C3/124  104/124  1C9/129  llC/129 
lU/133  115/133  113/136  119/136  122/139  123/139  125/141  126/141 

128/U3  129/U3  131/145  132/145  133/U6  134/146  136/143  137/14S 

138/149  139/149  IaC/150  ia/150  1^2/150  143/- 

200  C/8  1/11  2/13  3/15  4/16  5/I8  6/20  7/21  8/23  9/24  10/26  11/27 

12/29  13/30  14/32  16/34  17/36  19/38  2C/4O  23/43  24/45  26/47 

27/49  31/53  32/55  36/59  37/61  43/67  44/69  51/76  52/78  63/39 

64/91  llC/137  111/137  123/149  124/149  132/157  133/157  140/164 
UI/I64  U6/169  147/169  152A74'  153/174  156/177  157/177 

161/181  162/181  165/184  166/184  169/187  17C/1S7  172/189  173/189 

175/191  176/191  178/193  179/193  lSl/193  182/195  183/1‘.6  184/196 

186/198  187/198  188/199  189/199  190/2CC  191/20C  192/2CC  193/- 

300  C/8  1/11  2/13  3/15  4/17  5/18,  6/2 C  7/22,8/23  9/25  lC/26  11/28 

12/29  13/31  15/33  16/35  17/36  18/38  2C/40  21/42  23/44  2^46 

27/49  28/51  31/54 '32/56  35/59  36/61  4C/65  41/67  45/71  ^6/73  51/78 

52/80  58/36  59/88  66/95  67/97  76/1C6  77/1C8  38/119  89/121  107/139 
1C8/U1  l6C/i93  161/195  180/222  181/^12  193/224  194/224  2C4/234 

■  2C5/234  213/242  214/242  221/249  222/249  223/255  229/255  234/26C 

235/260  240/265  241/265  245/269'  246/269  250/273  251/273  255/277 

256/277  2,59/280  260/230  263/283  264/283  266/235  267/285  27 C/2'8 3 
27y 288  273/290  274/290  276/292 
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I  UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS;  ONE-SIDED  LIMITS 

► '  C  =  One-sided  confidence  level 

i’ .  N  =  Sample  size 

tv.  F  =  Observed  number  of  failures  in  a  sample  of  N  trials 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE  SIDED  LIMITS 
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C  =  One-Sided  confidence  level 
N  =  Sample  size 

F  =  Observed  number  of  failures  in  a  sample  of  N  trials 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 
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C  =  One-sided  confidence  level 
N  =  Sample  size 

^  =  Observed  number  of  failures  in  a  sample  of  N  trials 
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UPPER,  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

C  =  Ona 

-sided  confidence  level 

N  =  Sample  size 

F  =  Observed  number  of  failures  in  a  sample  of  N  trials 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 
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C  =  On^-sided  confidence  level 
N  =  Sample  size 

F  =  Observed  number  of  failures  in  a  sample  of  N  trials 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

C  =  One-sided  confidence  level 
N  =  Sample  size 

F  =  Observed  number  cf  failures  in  a  sample  of  N  trials 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 


C  =  One-sided  confidence  level 

N  =  Sample  size 

F  =  Observed  nurnber  of  failures  in  a  sample  of  N 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

C  =  One-sided  confidence  level 
N  =  Sample  size 
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UPPER  LIMITS  OF  BINOMIAL, CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

C  =  One-sided  confidence  level 
N  =  Sample  size 

F  =  Observed  numbei  of  failures  in  a  sample  of  N  trials 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

C  =  One-sided  confidence  level 
N  =  Sample  size 

F  =  Observed  number  of  failures  in  a  sample  of  N  trials 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

C  »  One-sided  confidence  level 
N»^mplesize 

F  »  Observed  number  of  failures  ir  a  sample  of  N  trials 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

C  ■  One-sided  confidence  level 
N  =  Sample  size 

F  *  Observed  number  of  failures  in  a  sample  of  N  trials 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

C  =  One-sided  confidence  level 
N  =  Sample  size 

F  =  Observed  number  of  failures  in  a  sample  of  N  trials 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

C  =  One-sided  confidence  level 
N  =  Sample  size 

F  =  Observed  number  cf  failures  in  a  sample  of  N  trials 
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0.1*61 

0.1*91* 

0.521 

0.572 

0.590 

18 

0.U21 

0.1*8U  ’ 

0.517 

0.51*1* 

0.591* 

0.612 

19 

o.UUt 

0.507 

0.51*0 

0.567 

0.616 

0.631* 

20 

0.  U66 

0.529 

0.562 

0.589 

0.638 

0.655 

21 

0.U89 

0.552 

0.581* 

0.611 

0.659 

0.676 

22 

0.511 

0.571* 

0.606 

0.632 

0.680 

.  0.696 

23 

0.53U 

0.596 

0.628 

0.651* 

0. 700 

0.716 

2U 

0.556 

0.618 

0.650 

0.675 

0.720 

0. 736 

25 

0.579 

0.61*0 

0.671  . 

0.696 

0. 71*0 

0.755 

26 

0.601 

0.662 

0.692 

0.716 

0.759 

0.771* 
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1 

UPPER  LIMITS  OF 

BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS;  ONE-SIDED  LIMITS 

' 

C  =  One-sided  confidence  level 

N  =  Sample  size 

■  1 

F  =  Observed  number  of  failures  in  a  sample  of  N  trials 

1 

N  ■  £  C 

.500 

.800 

.900 

i22o 

i22o 

.995 

0 

0.015 

0.035 

o.o5o 

0.06U 

0.097 

0.111 

1 

0.037 

0.065 

0.08U 

0.101 

0.139 

0.15U 

2 

0.059 

0.093 

o.iiU 

0.133 

0.17U 

0.190 

3 

3 

0.081 

0.119 

0. 1U2 

0.163 

0.206 

0.223 

h 

0.103 

O.li.'b 

0. 170 

0.192 

0.237 

0.25U 

0.125 

0.170  ■ 

0.196 

0.220 

0.266 

0.281i 

6 

0.1U7 

0.195 

0.222 

0.2li6 

0.29U 

0.312 

7 

0.169 

0.219 

0.2li8 

0.272 

0.321 

0.339 

8 

0.191 

0.2U3 

0.273 

0.298 

0.317 

.  0.366 

ki 

9 

0.213 

0.267 

0.297 

0.323 

0.373 

0. 392 

10 

0.235 

0.291 

0.322 

0.3li8 

0.398 

0.1I17 

11 

0.257 

0.311i 

0.3li6 

0.372 

0.1i23 

0.l4ii2 

12 

0.279 

0.337 

0.369 

0.396 

O.Ui7  ' 

O.li^ 

13 

0.301 

0.361 

0.393 

0.1i20 

0.U71 

0.1i89 

1 

Hi 

0.32U 

0.38U 

0.1il6 

0.1iU3 

O.U9li 

0.513- 

'  » 

15 

0.3li6 

0.ii06 

O.U39 

0.1i66 

0.517  ' 

0.535 

16 

0.368 

0.1i29 

O.U62 

0.U89 

0.539 

0.553 

17 

0.390 

o.Ii5l 

O.liSlt 

0.511 

0.562 

0.580 

18 

0.1il2 

0.1i7U 

0.507 

0.533 

0.583 

0.601 

19 

0.1i3U 

O.U96 

0.529 

0.555 

0.6o5 

0.623 

20 

0.1i56 

0.518 

0.551 

0.57? 

0.626 

0.6ii3 

i 

.  ,  21 

O.U78 

0.5U0 

0.573 

0.599 

0.61i7 

0.66U 

1* 

22 

0.500 

0.562  • 

0.59U 

0.620 

0.667 

0.68U 

23  , 

0.522 

0.58li 

0.616 

0.6Ja 

0. 668 

0.70ii 

•> 

2U 

o.5Uii 

0. 6C6 

0.637 

0.'662 

0.708 

0. 723 

25 

0.566 

0.627 

0.658 

0.683 

0.727 

0.7U3 

26 

0.588 

0.6U8  ' 

0.679 

0. 703 

0.7U6 

0. 761 

**• 

i 

27 

0.610 

0.670 

0.699 

0.723 

0.  765 

0.780 

U6  0 

0.015 

0.03U 

,  0.0U9 

0.063 

0.095  , 

0.109 

1 

0.036 

0.061i 

0.082 

0.099 

0.136 

0. 151 

2 

0.058 

0.091 

0.112 

0.131 

0.170 

0.186 

3 

0.079 

0.117. 

O.lliO 

0.160 

0.202 

0.219 

> 

U 

0.101 

0.lli2 

0. 166 

,  0.188 

0.232 

0.2U9 

,5 

0.122 

0.166 

0.192 

0.215 

0.261 

0.278 

— 

6 

0.  lIiU 

0.191 

0.218 

o.2ia 

0.288 

0.306 

7 

0.166 

0.215 

0.2U3 

0.267  . 

0.315 

0.333 

8 

O.lC/ 

0.238 

0.267 

0.292 

O.3I4I 

0.359 

.9  . 

0.209 

0.262 

0.291 

0.317 

0.366 

a.38U 

' 

1 

10 

0.230 

0.285 

0.315 

0.3U1 

0.391 

O.U09 

11 

0.252 

0.308 

0.339 

0.365 

o.ia5 

O.U33 

12 

0.273 

0. 330 

0.362 

0.388 

0.1i39 

0.U57 

1 

13 

0.295 

0.353 

0.385 

O.Ull 

0.1i62 

0.1*80 

5 

» 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

C  ^  One-sided  confidence  level 
N  Sample  size 

F  *  Observed  number  of  failures  in  a  sample  of  N  trials  ■ 


1 

C  .500 

.800 

zm 

.950 

.990 

Hi 

0.317 

0.376 

0.U08 

0.U3U 

O.U85 

0.503 

15 

0.338 

0.398 

0.U30 

0.157 

0.507 

0.526 

16 

0.360 

O.U20 

O.U52 

0.1i79 

0.529 

0.5U8 

17 

0.381 

0.1iJi2 

O.U75 

0.501 

0.551 

0.569 

18 

O.U03 

0.li61i 

O.U97 

0.523 

0.S73 

0.591 

19 

O.U2ii 

0.U86 

0.518 

0.5Ii5 

o.59ii 

0.612 

20 

0.1ili6 

0.508 

0.51i0 

0.566 

0.615 

0.632 

21 

0.1i68 

0.529 

0.561 

0.587 

0.635 

0.653 

22 

0.1i89 

0.551 

0.583 

0.608 

0. 656 

0.672 

23 

0.511 

0.572 

0.60U 

0.629 

0.676 

0.692 

2U 

0.532 

0.593 

0.625 

0.650 

0.695 

0.711 

25 

0-55U 

0.615 

0.6I45 

0.670 

0.715 

0.730 

26 

0.576 

0.636 

0.666 

0.690 

0.73li 

6. 7k9 

27 

0.597 

0.656 

0.686 

0.71O 

0. 752 

0. 767 

0 

0.015 

0.03li 

O.Ca8 

0.062 

0.093 

0.107 

1 

0.035 

0.062 

0.080 

0.097 

0.133 

O.HiS 

,2 

0.056 

0.089 

0.109 

0.128 

0^167 

0.183 

3 

0.078 

O.llU 

0.137 

0.157 

0.198 

0.215 

U 

0.099 

0.139 

0.163 

0.18U 

0.228 

0.2liii 

5 

0.120 

0.163 

0.188 

0.211 

0.256 

0.273 

6 

o.lia 

0.187 

0.213 

0.237 

0.283 

0.300 

7 

0.162 

0.210 

0.238 

0.262 

0.309 

0.327 

8 

0.183 

0.253 

0.262 

0.236 

0. 33U 

0.352 

9 

0.20U 

0.256 

0.285 

0. 310 

0.359 

0.377 

Id 

0.225 

0.279 

0. 309 

0.33U 

0. 333 

O.U02 

11 

0.2li7 

0. 301 

0.332 

0.358 

O.U07 

0.1i25 

12 

0.268 

0.-  32li 

0.355 

0.381 

O.U30 

0M9 

13 

0.289 

O.3U6 

0.377 

O.U03 

O.U53 

0.1i72  , 

lii 

0. 310 

0. 368 

0. 399 

O.U26 

O.U76 

0.U9U 

IS 

0.331 

0.390 

0.U22 

O.hhd 

0.U98 

0.516 

16 

'  0.352 

0.U12 

O.iiitii 

O.UVO 

0.520 

0.538 

17 

0. 373 

O.U33 

0.U65 

0.U92 

0.51a 

0.559 

13 

0. 39li 

O.U55 

O.U37 

0.513 

0.563 

0.580 

19 

O.U16 

,  O.U76 

0.5o8 

,  0.535 

0.583 

0.601 

20 

0.U37 

0.U98 

0.S30 

0.556 

O.60U 

0.621 

21, 

O.Ji58 

0.519 

0.551 

0.577 

0.62U 

o.6ia 

22 

0.U79 

0.5U0 

0.571 

0.597 

0.6Uli 

0.661 

23 

0.50c 

.0.561 

0.592 

0.618  , 

0.66U 

0.681 

2U 

0.521 

,0.582 

O.613 

0.638 

0.683 

0.700 

25 

0.5U2 

0.602 

0.633 

0.658 

0.703 

0.718 

26 

0.563 

0. 623 

0.653 

0.678 

0.721 

, 0. 737 

27 

0.585 

0.6UjLi 

0.673 

0,697 

0.7li0 

0. 755 

28 

0.606 

0.6^ 

0.693 

0.717 

0.758 

0.773 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

C  =  One-sided  confidence  level 
N  =  Sample  size 

F  =  Observed  number  of  failures  in  a  samplo  of  N  trials 


N 

U8 


U9 


1 

c 

.300 

.800 

.900 

z22o 

0 

o.oiU 

0.033 

0.0U7 

6.061 

0.091 

o;io3 

1 

0.033 

0.061 

0.079 

0.093 

0.130 

o.ili3 

2 

0.033 

0.087 

0.107 

0.125 

O.I6U 

■  0.179 

3 

0.076 

0.112 

O.I3U 

0.13U 

0.19U 

0.210 

U 

0.097 

0.136 

0.160 

0.181 

0.223 

0.2U0 

5 

0.117 

0.160 

0.183 

0.207 

0.251 

0.263 

6 

0.138 

0.183 

0.209 

0.232 

0.277 

0.293 

7 

0.1'^9 

0.206 

0.233 

0.237 

0.303 

0.321 

8 

0.179 

0.229 

0.237 

0.281 

0.328 

0.3U6 

9 

0.200 

0.231 

0.280 

O.30U 

0.332 

0.370 

10 

0.221 

0.273 

0.303 

0.328 

0.376 

’  '  0. 39U 

11 

,  0.2U1 

0.293 

0.323 

0.331 

o.Uoo 

.  0.U18 

12 

0.262 

0.317 

0.3li8 

0.373 

O.U23 

o.ua 

13  ■ 

- 

0.283 

0.339 

0.370 

0.396 

o.Mi5 

0.U63 

lU 

0.303 

0.361 

0.392 

0.UI8 

0.U67 

O.U83 

13 

0.32U 

0.382 

O.Ulit 

O.hhO 

O.U89 

0.507 

16 

0.3li3  , 

O.UoU 

C.ii33 

0.1i6l 

0.311 

0.329 

17 

0. 366 

O.U23 

O.U36 

O.U83 

0.332 

0.330 

18 

0.386 

O.Ulio 

0.1i78 

O.30U 

0.353 

0.370 

19 

0.U07 , 

0.1t67 

0.h99 

0.323 

0.573 

0.391 

20 

0.U28 

O.U88 

0.519 

0.5U3 

0.39U 

0.611 

21 

o.Ui8 

0.309 

o.5iiO 

0.366 

0.6IU 

0.631 

22 

.  0.169 

0.329 

0.361 

0.586 

0.633 

0.650 

23 

0.U90 

0.330 

0.381 

0.606 

'  0.653 

0.669 

2h 

0.31C 

0.370 

0.601 

0.626 

0.672 

0. 688 

23 

0.331 

0.391 

0.621 

0.6U6 

0.691 

0.707 

26  • 

0.332 

0.611 

0.6UI 

0.666 

0.  710 

0.  725 

27 

0.372 

0.631 

0.661 

0.685 

C.  728 

0.7U3 

26 

0.393 

0.631 

0.681 

O.70U 

0.7U6 

0.761 

0 

o.olU 

0.032 

O.0U6 

0.039 

0.090 

0.102 

1 

0.03U 

0.060 

6.077 

0.093 

0.128 

0.1U2 

2 

0.03U 

0.083 

0.103 

0.123  . 

0.161 

0.176 

3 

0.07U 

0.110 

0.131 

0.131 

0.191 

0.207 

U 

0.093 

0.133 

0.137 

0.177 

0. 219 

0.235 

3 

0.113 

0.137 

0..181 

0.203 

O.2U6 

0.263 

6 

0.133 

0.179 

■  0.203 

0.227 

0.272 

0.289 

7 

0.133 

0.202 

0.229 

0.232 

0.297 

0.313 

8 

, 

0.176 

0.22U 

0.232 

0.275 

0.322 

0. 3Uo 

9 

0.196 

0.2U6 

0.27li 

0.299 

0.3ii6 

0.  36U 

10 

•  0.216 

0.268 

0.297 

0.322 

0.369 

0.387 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITP 

C  =  One-sided  confidence  level 
N  =  Sample  size 

F  =  Observed  number  of  failures  in  a  sample  of  N  trials, 


1 

C 

.500 

.800 

.990 

11 

0.237 

0.290 

0.319 

0.31;!; 

0.392 

o.Uio 

12 

0.25? 

0.311 

o.3ia 

0.366 

o.ia5 

0.1;33 

13 

0.277 

0.333 

0.363  . 

0. 383 

0.1;37 

.  0.1;55 

11; 

0.297 

0.351; 

0.381; 

o.iao 

0.^59 

0.1;77 

15 

0.313 

0.375 

0.1;06 

0.1;32 

0.U81 

0.1;98 

16 

0.338 

0.396 

0.1;27 

0.163 

0.502 

0.520 

17 

0.358 

O.Ul? 

0.i;i;8 

o.UTU 

0.523 

0.51;0 

18 

0.'378 

0.i;37 

0.1;69 

0.1;95 

0.51;3 

0.561 

19 

0. 399 

O.U58 

0.);89 

0.515 

0.563 

0.581 

20 

o.ia9 

0.1;79 

0.510 

0.536 

0.583 

0.601 

21 

0.ii39 

O.U99 

0.530 

0.556 

0.603 

0.620 

22 

0.U59 

0.519 

0.550 

0.576 

0.623 

0.639 

23 

O.iiSo 

0.539 

0.570 

0.596 

0.6U2 

0.658 

21; 

0.500 

0.560 

0.590 

0.615 

0.661 

0.677 

25 

0.520 

0.580 

0.610 

0.635 

0.680 

0.695 

26 

0.5U1 

0.600 

0.630 

0.651; 

0.698 

0.711; 

27 

0.561 

0.619 

0.61i9 

0.673 

0.716 

0.731 

28 

0.581 

0.639 

0.668 

0.692 

0. 731; 

0.71x9 

29 

0.601 

0.659 

0.683 

0.711 

0.752 

0.766 

0 

O.Oll; 

0.032 

O.OU5  ' 

0.058 

0.088 

0.101 

1 

0.033 

0.059 

0.076 

0.091 

0.126 

0.139 

2 

0.053 

0.08U 

0.103 

0.121  ' 

0.158 

0.173 

3 

0.073 

0.108 

0.129 

0.11;8 

0.187 

0.203 

U 

0.093  ' 

0.131 

0.151; 

0.171; 

0.215 

0.231 

5 

0.113 

0.151; 

0.178 

0.199 

0.2h2 

0.258 

6 

0.133 

0.176 

0.201 

0.223 

0.26? 

0. 2olx 

7 

0.152 

0.198 

0.22U 

0.2U7 

0.292 

0.309 

8  , 

0.172 

0.220 

0.2U7 

0.270 

0.316 

0.333 

9 

0.192 

0.2U1 

0.269 

0.293 

0.3l;0 

0.357 

10 

0.212 

0.263 

0.291 

0.33.6 

0.363 

0.380 

11  ' 

0.232 

0.28U 

0.313 

0.338 

0.385 

0.1x03 

12 

0.252 

0.305 

0.335 

0.360 

O.U08 

0.1x25 

13 

0.272 

0.326. 

0.356 

0.381 

0.1x30 

0.’:!;7 

Ih 

0.291 

0.3l;7 

'  0.377 

0.1;03 

0.U51 

0.1x69 

15 

■  0. 311 

0. 368 

0. 398 

0.1;2l; 

0.1x72 

0.1x90 

16 

0.331 

0.388 

o.m9 

0.^5  . 

0.1x93 

0.511 

17 

0.351  ' 

0.L09 

O.UiO 

0.  U65 

0.5llx 

0.531 

18 

0.371 

0.1i29 

0.1i60 

O.U86 

.  0.53lx 

0.551 

19 

0.391 

O.Uli9 

O.U80 

0.506 

0.55U 

0.571 

20 

'  o.Uii 

0.1i69 

0.501 

0.526 

0.571; 

0.591 

til 


UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

C  ~  One-sided  confidence  ievel 
N  =  Sample  size 

F  =  Observed  number  of  failures  in  a  sample  of  N  trials 


I 

c 

.500 

.800 

iiQO- 

4^220. 

.995 

21 

0.1i30 

0.  U90 

0.521 

o.5Ii6 

0.593 

0.610 

22 

o.li5o 

0.510 

0.5U0' 

0.566 

0.612 

0.629 

23 

o.hio 

0.529 

0.560 

0.585 

0.631 

0.6U8 

2U 

.  0.U90 

0.5U9 

0.580 

0.605 

0.650 

0.6^ 

2^ 

0.510 

0.561 

0.599 

0.62li 

0. 669 

0.681i 

26 

0.530 

0.588 

0.618 

0.61i3 

0.687 

0.702 

27 

0.550 

0.6o8 

0.638 

0.662 

0. 705 

0. 720 

28 

0.570 

0.627 

0.657 

0.680 

C.723 

0.737 

29 

.0.589 

0.6U7 

0.675 

0.699 

O.7U0 

C.755 

30 

0.609 

0.666 

0.69u 

0.717 

0.757 

0.771 

0 

0.013 

0.029 

O.Olil 

0.053 

0.080 

0.092 

1 

0.030 

0.053 

0,069 

0.083 

0.015 

•  0.127 

2 

0.0U8 

0.076 

0.09li 

0.110 

O.liili 

0.158 

3 

0.066 

0.098 

0.117 

0.135 

0.171 

0.186 

U 

0.08U 

0.119 

O.lliO 

0.159 

0.197 

0.212 

0.102 

O.HiC 

0.162 

0.182 

0.221 

0.237 

6 

0.121 

0.160 

0.18U 

O.20U 

0.2li5 

0.261 

7 

0.139 

0.181 

0.205 

0.226 

0.268 

0.28Ii 

8 

0.157 

0.200 

0.226 

0.2li7 

0.290 

0. 306 

9 

0.175 

0.220 

0.2li6 

0.268 

0.312 

0.328 

10 

, 0.193 

0.2li0  . 

0.266 

0.289 

0.333 

0.  350 

li 

0.211 

0.259 

0.286 

0.309 

'  0.35Ii 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

C  =  One-sided  confidence  level 
N  =  Sample  size 

F  =  Observed  number  of  failures  in  a  sample  of  N  trials 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

C  =  One-sided  confidence  level 
N  =  sample  size 

F  =  Observed  number  of  failures  in  a  sample  of  N  trials 


I  c 

.500 

.800 

.900 

♦  995 

11 

0.179. 

0.221 

0.2lili 

0.265 

0.30U 

0.319 

12 

0.19li 

0.237  • 

C.26I 

0.262 

0.322 

0.337 

13 

0.209 

0.253 

0.278 

0.299 

0.3li0 

0.355 

Hi 

0.225 

0.270 

0.285 

0.316 

0.357 

0.373 

1$ 

0.2li0 

0.286 

0.311 

0.333 

0.37U 

0.390 

16 

0.255 

0.302 

0.328 

0.350 

0.391 

0.1:07 

17 

0.270 

0. 318 

0.3Uli 

C.366 

O.liOS 

0.1:21: 

18 

0.286 

0.33li 

0.360 

0:382 

0.1i25 

0.ij:0 

19 

0.301 

0.350 

0.377 

0.399 

O.lilil 

0.1:57 

20 

0. 316 

0. 366 

0.393 

o.ia5 

O.U57 

0.1:73 

21 

0.332 

0.382 

0.1i09 

0.1i31 

0.1:73 

0.1:39 

22 

0.3li7 

0.397 

0.1i2U 

0.1ili7 

0.1i89 

o.5o5 

23 

0.362 

0.1il3 

O.liiiO 

0.ii63 

0.5o5 

0.521 

2U 

0.378 

'0.li29 

0.1i56 

0.1i78 

0.521 

0.536 

0.393 

o.IiliU 

0.li72 

0.1i9U  ■ 

0.536 

■  0.552 

0 

0.010 

0.023 

0.032. 

0.0li2 

o.oSk 

0.073 

1 

0.02li 

0.0U2 

0.05U 

0.066 

0.091 

0.101 

2 

0.038 

0.060 

().07ii 

0.08'’ 

0.115 

0.126 

3 

0.052 

0.077 

0.093 

0.107 

0.136 

0.H8 

U 

0.066 

0.09U 

0.111 

0.126 

0.157 

0. 169 

9 

0.081 

0.111 

0.128 

O.Hili 

0.-77 

0.189 

6 

0.095 

0.127 

■  O.Hi6 

0.162 

0.196  , 

0.209 

7 

0,109 

O.Hi3 

0.162 

O.I8O 

0.211: 

0.227 

8 

0.123 

0.159 

0.179 

0-197 

0.232 

0. 21-6 

9 

0.137 

0.17li 

0.195 

0.2Hi 

0.250 

0. 264 

10 

0.152 

0.190 

0.212 

0.230 

0. 267 

0.261 

11 

0.166 

0.205 

0.228 

0.2li7 

0.281: 

0.299 

12 

0.180 

0.221 

'O.2U3 

0.263 

0.301 

0. 315 

13 

0.19li 

0.236 

0.259 

0.279 

0.318 

0.332 

Hi 

0.209 

0.251 

0.275 

0.295 

0.331: 

.  0.3U9 

'  15 

0.223 

0.266 

0.290 

0.311  • 

0.350 

0.365 

16 

0.237 

0.281 

0.306 

0. 326 

0.366 

•  0. 381 

17 

0.251 

0.296 

0.321 

0.3U2 

0.382 

■  0.397 

18 

0.265 

0.311 

.  0.336 

0.357 

0.397 

0.1:12 

19 

0.280 

0.326 

0.351 

0.372 

0.IH.3 

0.1:28 

20 

0.29li 

0.3U1 

0.366 

0.388 

0.1:28 

O.Uli3 

21 

0.308 

0.356 

0. 381 

0.1*03 

0. 1:1:3 

0.1:58 

22 

6.322 

0.370 

0.396 

0.1il8 

0.1:58 

0.1:73 

23 

0.337 

0.385 

O.lill 

0.1i32 

•  0.1:73 

0.1:88 

2U 

0.351 

0.399 

0.1i25 

0.1ili7 

0.1:88 

0.503 

25 

0.365 

o.lilli 

•  o.lii^ 

0.U62 

0.502 

0.518 

CD  Onw  O  OWjJ  O  On  fO  Oo4r  O  VaO  VnO4=r00MU>VA<r-^ 


UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMiTS 

C  =  One-sided  confidence  level 
N  =  Sample  size 

F  =  Observed  number  of  failures  in  a  sample  of  N  trials 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

C  =  One-sided  confidence  level 
N  =  Sample  size 

F  =  Observed  number  of  failures  in  a  sample  of  N  trials 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 
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C  =  One-sided  confidence  level 
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N  =  Sample  size 
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F  =•  Observed  number  of  failures  in  a  sample  of  N  trials 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

C  =  One-sided  confidence  level 
N  =  Sample  size 

F  =  Observed  number  of  failures  in  a  sample  of  N  trials 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

C  =  One-sided  confidence  level 
N  =  Sample  size 

F  =  Observed  number  of  failures  in  a  sample  of  N  trials 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

- 

C  One-sided  confidence  level 

N  =  Sample  size 

F  =  Observed  number  of  failures  in  a  sample  of  N  trials 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

C  =  On«5-sided  confidence  level 
N  =  Sample  size 

F  »  Observed  number  of  failures  in  a  sample  of  N  trials 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

C  =  One-sided  confidence  level 

N  =  Sample  size 

F  =  Observed  number  of  failures  in  a  sample  of  N  trials 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

C  =  One-sided  confidence  level 
N  =  Sample  size 

F  »  Observed  number  of  failures  in  a  sample  of  N  trials 


H  Z  c 

21 

22 

23 

21; 

25 

26 

27 

28 

29 

30 

31 

32 

33 

31; 

35 

36 

37 

38 

39 
iiO 
Ui 
h2 
U3 
hh 
U5 
U6 
U7 
U8 
1;9 

5o  • 

160  0  ■ 

1 

2 

3 

U 

'  5 


.500 

.800 

0.114; 

0.169 

0.151 

0.176 

0.157 

0.183 

0.161; 

0.191 

0.171 

0.193 

0.177 

0.205 

0.181; 

0. 212 

0.191 

0.219 

0.197 

0.226 

0.201; 

0.233 

0.211 

0.239 

0.217 

0.2l;6 

0.221; 

0.253 

0.231 

0.260 

0.237 

0.267 

0.214; 

0.271; 

0.251' 

0.261 

0.257 

0.288 

0.261; 

0.295 

0.271 

0.302 

0.277 

0.309 

0.281; 

0.315 

0.290 

0.322 

0.297 

0.329 

0.301; 

0.336 

0.310 

C.3l;3 

0.317 

0.350 

0.  3.21; 

0.356 

0.330 

0.363 

0. 337 

0.370 

o.ooU 

o.bio 

0.010 

0.019 

0.017 

0.027 

0.023 

0.031; 

0.029 

■0.0U2 

0.035 

0.0l;9 

J!Q0 

0.183 

0.195 

0.191 

0.203 

0.196 

0.210 

0. 205 

0.218 

0.212 

0.225 

0.220 

,  0.232 

0.227 

0.2l;0 

0.231; 

0.2l;7 

0.2l;l 

0.251; 

0.2l;8 

0.261 

0.255 

0.269 

0.262 

■  0.276 

0.269 

0.283 

0.276 

0.290 

0.283 

0.297 

0.291 

O.30I; 

0.298 

0. 311 

0.305 

0.318 

0.311 

0.326 

0.318 

0.333 

0. 325 

0.3l;0 

0..332 

0.3U7 

0.339 

0. 351; 

0.31;6 

0. 361 

0.353 

0.368 

0.360 

0.371;, 

0.367 

0. 381 

0.373 

0.388 

0.381 

0.395 

0.387 

0.1;02 

O.OIU 

0.019 

0.021; 

0.029 

0.033  , 

0.039 

O.OUl 

0.0l;8 

0.0l;9 

0.056 

0.057 

0.065 

^  i22i 


0.219 

0.228 

0.227 

0.236 

0.231; 

0.2l;3 

0.2h2 

0.251 

0.2U9 

0.259 

0.257 

0.266 

0.265 

0.271; 

0 

1.272 

0.281 

0.279 

0.289 

0.287 

0.296 

0.291; 

O.30I; 

0. 302 

0.311 

0. 309 

0.319 

0. 316 

0.326 

0. 321; 

0.333 

0.331 

0.3l;l 

0.338 

0.31;8 

0.31;5 

0.355 

1,352 

0.362 

0.360 

0.370 

0.367 

0.377 

0.371; 

'  0. 381; 

0. 381 

0.391 

0.388 

0.398 

0.395 

0.1;05 

0.1;02 

0.1;12 

0,1;09 

0.1;19 

Q 

4l;16 

0.1;26 

r-. 

1 

h23  ■ 

O.U33 

y, 

430 

0.14;0 

0. 

028 

0.033 

0, 

oUl 

0.0l;6 

0. 

051 

0.057 

0, 

061 

0.067 

0, 

071 

0.077' 

0. 

080 

0.086 

12S 


UPPER  LIMITS  OF  BINOMlAL  CONFIDEriCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMIT? 

C  =  One-sided  confidence  level 
N  =  Sample  size 

F  =  Observed  number  of  failures  in  a  sample  of  N  trials 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

C  *  One-sided  confidence  level 
N  *  Sample  size 

F  =  Observed  number  of  failures  in  a  sample  of  N  trials 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

C  =  0ne-siic*3d  confidence  level 
N  =  Sfimpie  size 

F  =  Observed  number  of  failures  in  a  sample  of  N  trials 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

C  =  One-sided  confidence  level 
N  =  Sample  size 

F  =  Observed  number  of  failures  in  a  sample  of  N  trials 
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C  =  One-sided  confidence  level 

N  =  Sample  size 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

C  =  One-sided  confidence  level 
N  =  Sample  size 

F  =  Observed  number  of  failures  in  a  sample  of  N  trials 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

C  =  One-sided  confidence  level 
N  =  Sample  si2e 

F  =  Observed  number  of  failures  in  a  sample  of  N  trials 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  IN  fERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

C  =  One-sided  confidence  level 
N  =  Sample  size 

F  =  Observed  number  of  failures  in  a  sample  of  N  trials 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

• 

C  =  One-sidec  confidence  level 

N  =  Sample  size 

F  =  Observed  number  of  failures  in  a  sample  of  N  trials 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS;  ONE-SIDED  LIMITS 

C  =  One-sided  co'ifidence  level 
N  =  Sample  s'iie 

F  =  Observed  number  of  failures  in  a  sample  of  N  trials 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

C  =  One-sided  confidence  level 
N  =  Sample  size 

F  =  Observed  number  of  failures  in  a  sample  of  N  trials 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

C  =  One-sided  confidence  level 
N  =  Sample  size 

F  =  Observed  number  of  failures  in  a  sample  of  N  trials 
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C  =  One-sided  confidence  level 
N  =  Sample  size 

F  =  Observed  number  of  failures  in  a  sample  of  N  trials 
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C  =  One-sided  confidence  level 
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C  =  One-sided  confidence  level 
N  =  Sample  size 

F  =  Observed  number  of  failures  in  a  sample  of  N  trials 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

C  «  One-sided  confidence  Imel 
N  *  Sample  size 

F  «  Observed  number  of  failures  in  a  sample  of  N  trials 


I-  £ 

Joo 

.800 

.900 

42i 

li2 

0.071 

0.080  ‘ 

0.085 

0.090 

0.098 

0.101 

U3 

0.073 

0.082 

0.087 

0.091 

0.100 

0.103 

Ui 

0.07U 

0.08U 

0.089 

0.093 

0.102 

0.105 

U5 

0.076 

0.086 

0.091 

0.095 

o.loU 

0.107 

U6 

0.078 

0.087 

0.093 

0.097 

0.106 

0.109 

U7 

0.079 

0.089 

0.09U 

0.099 

0.108 

0.111 

U8 

0.081 

0.091 

0.096 

0.101 

0.109 

0.113 

h9 

,  0.083 

0.093 

0.098 

0.102 

0.111 

0.115 

9o 

0.08U 

0.09U 

0.100 

o.loU 

0.113 

0.117 

$1 

0.086 

0.096 

0.101 

0.106 

0.115 

0.119 

52 

0.088 

0.098 

0.103 

0il08 

0.117 

0.120 

53 

0.089 

0.100 

0.105 

0.110 

0.119 

0.122 

5U 

0.091 

0.101 

0.107 

0.112 

0.121 

0.121* 

55 

0.093 

0.103 

0.109 

0.113 

0.123 

0.126 

56 

0.09U 

0.105 

0.110 

0.115 

0.125 

0.128 

57 

0.096 

0.106 

0.112 

0.117 

0.126 

0.130 

58 

0.098 

0.108 

o.llii 

0.119 

0.128 

0.132 

59 

0.099 

0.110 

0.116 

0.121 

0.130 

0.131* 

6o 

0.101 

0.112 

0.118 

0.122 

0.132 

0.136 

61 

0.103 

0.113 

0.119 

0.12U 

0.13li 

0.138 

62 

O.lOU 

0.115 

0. 121 

0.126 

0.136 

0.139 

63 

0.106 

0.117 

0.123 

0.128 

0.138 

o.iia 

6U 

0.108 

0.119 

0.125 

0.130 

0.139 

0.11*3 

65 

0.109 

0.120 

0.126 

0.i31 

o.u*i 

0.11*5 

66 

0.111 

0.122 

0.128 

0.133 

0.11*3 

0.11*7 

670.113 

0.113 

0.12U 

0.130 

0.135 

0.11*5 

0.11*9 

68 

O.lU; 

0.126 

0.132 

0.137 

0.11*7 

0.151 

69 

0.116 

0.127 

0.133 

0.138 

0.11*9 

0.152 

70 

0.118 

0.129 

0.135 

0.iU0 

0.151 

0.1511 

71 

0. 119 

0.131 

0.137 

O.Ui2 

0.152 

0.156 

72 

0.121 

0.133 

0.139 

o.liUi 

0.151* 

0.158 

73 

0.123 

0.13U 

o.iia 

0.1ii6 

0.156 

0.160 

0 

0.001 

0.002 

o.ooU 

0.005 

0.007 

0.008 

r- 

0.003 

0i005 

0.006 

O.O07 

0.010 

0.011 

2 

o.ooU 

0.007 

0.008 

0.010 

0.013 

O.Oll* 

3 

0.006 

0.008 

0.010 

0.012 

0.015 

0.017 

U 

0.007 

0.010 

0.012 

O.OlU 

0.018 

0.019 

5 

0.009 

0.012 

o.ou* 

0.016 

0.020 

0.022 

148 


UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE  SIDED  LIMITS 

C  *  One-sided  confidence  level 
N  =  Sample  size 

F  =  Otrrerved  nurnber  of  failures  in  a  sample  of  N  trials 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

• 

C  *  One-sided  confidence  level 

N  *  Sample  size 
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F  «  Observed  number  of  failures  in  a  sample  of  N  trials 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

C  >  One-sided  confidence  level 
N  >  ^mple  size 

F  >  Observed  number  of  failures  in  a  sample  of  N  trials 
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0.125 

0.128 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

• 

C  »  One-sided  confidence  level 

*  -  *  ■ 

N  »  Sample  size 

F  =  Observed  number  of  failures  in  a  »mpie  of  N  trials 

-  I  £ 

iioo 

.800 

.900 

• 

75o  0 

0.001 

0. 002 

0.003 

o.ooU 

0.006 

0.007 

1 

0.002 

o.ooU 

0.005 

0.006 

0.009 

0.010 

2 

o.ooU 

0.006 

0.007 

0.008 

0.011 

0.012 

3 

0.005 

0.007  . 

0.009 

0. 010 

0.013 

0.015 

■  U 

0.006 

0.009 

0.011 

0.012 

0.015 

0.017 

• 

5 

0.008 

0.011 

0.012 

o.olU 

0.017 

0.019 

6 

0.009  , 

0.012 

■O.oiU 

0.016 

0.019 

0.021 

7 

0.010 

O.OIU 

0.016 

0.017 

0.021 

0.023 

8 

0.012 

0.015 

0.017 

0.019 

0.023 

0.025 

9 

0.013 

0.017 

0.019 

0.021 

0.025 

0.026 

10 

O.Olli 

0.018 

0.020 

0.023 

0.027 

0.028 

• 

11 

0.016 

0.020 

0.022 

0.02U 

0.028 

0.030 

12 

0.017  . 

0.021 

0.02U 

0.026 

0.030 

0.032 

13 

0.018 

0.023 

0.025 

0.027 

0.032 

0.03U 

lU 

0.020 

0.02L 

0.027 

0.029 

0.03U 

0.035 

15 

0.021 

0.026 

0.028 

0.031 

0.035 

0.037 

-  ■  ■■•■ 

16 

0.022 

0.027 

0.030 

0.032 

0.037 

0.039 

• 

17 

0.02U 

0. 029 

0.031 

0.03U 

0.039 

o.oUl 

18 

0.025 

0.030 

0.033 

0.035 

O.OUO 

0.0U2 

19 

0.026 

0.031 

0.03U 

0.037 

0.0U2 

o.oUU 

20 

0.028 

0.033 

0.036 

0.039 

o.oUU 

0.0U6 

'  ■  ’  '•  < 

21 

0.029 

0.03il 

0.037 

o.oUo 

0.0U5 

0.0U7 

22 

0.030 

0.036 

0.039 

O.OU2 

0.0U7 

0.0U9 

• 

23 

0.032 

0.037 

O.OUO 

O.OU3 

0.0U9 

o.'o5i 

2U 

0.033 

0.039 

0.0U2 

0.0U5 

o.o5o 

0.052 

,  25 

0.03li 

o.oUo 

0.0U3 

0.0U6 

0.052 

0.05U 

26 

0.036 

0.0U2 

0.0U5 

0.0U8 

0.05U 

0.056 

27 

0.037 

0.0U3 

0.0U6 

0.0U9 

0,055 

0.057 

.i- 

28 

0.038 

o.oUli 

0.0U8 

0.051 

0.057 

0.059 

# 

29 

o.oUo 

O.OU6 

0.0U9 

0.052 

0.058 

0.061 

30 

o.oia 

0.0U7 

0.051 

0.05U 

0.060 

0.062 

31 

0.0ii2 

0.0U9 

0.052 

0.055 

0.061 

0.06U 

*  *  ! 

32 

o.olili 

o.o5o 

0.05U 

'  0.057 

0.063 

0.065 

1 

33 

0.0l;5 

0.052  . 

0.055 

0.056 

0.06^ 

0.067 

3li 

0.0U6 

0.053 

0.p57 

0.060 

0.066 

0.069 

,  35 

■0.0U8 

0.05U 

0.058 

0.061 

0.068 

0.070 

36 

0.0U9 

0.056 

0.060 

0.063 

0.069 

0.072 

'  '  **  ■ 

37 

o.o5o 

0.057 

0.061 

0.06U 

0.071 

0.073 

38 

0.052 

0.059 

0.063 

0.066 

0.072 

0.075 

39 

0.053 

o.o6o 

0.06U 

0.067 

0.01k 

0.077 

.  liO 

0.05U 

0.061 

0.065 

0.069 

0.076 

0.078 

Ul 

0.056 

0.063 

0.067 

0.070 

0.077 

0.080 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

C  «  One-sided  confidence  level 
N  «  Sample  size 

F  «  Observed  number  of  failures  in  a  sample  of  N  trials  ’ 


»  I  £ 

1x2 

1x3 

Ixlx 

IxS 

1x6 

1x7 

U8 

1x9 

50 

51 

52 

53 

SU 

55 

56 

57 

58 

59 

60 
51 
62 
63 
6U 
65 

800  0 
1 
2 
3 
h 

5 

6 

7 

8 

9 

10 
11 
12 
13 
11* 


.500  .800 

0.057  0.061i 

0.058  0.066 

0.060  0.067 

0.061  0.068 

0. 062  0. 070 

0.06u  0.071 

p.065  0.073 

0.066  0.071* 

0.068  0.076 

0.069  0.077 

0.070  0.078 

0.072  0.080 

0.073  0.081 

0.071*  0.083 

0.076  0.081* 

0.077  '  0.086 

0.078  0.087 

o.cSo  0.089 

0.081  0.089 

0.082  0.091 

O.O8I*  0.092 

0.085  0.091* 

0.086  0.095 

0.088  0.096 

0.001  0.002 

0.002  O.OOl* 

0.003  0.005 

0.005  0.007 

0.006  0.008 

0.007,  .  0.010 

0.008  0.011 

0.010  '  0.013 

0.011  0.011* 

0.012  0.016 

0.013  0.017 

0.015  0.018 

0.016  0.020 

0.017  0.021 

0.018  0.023 


.900 

.950 

0.068 

0,.072 

0.070 

0.073 

0.071 

0.075 

0.073 

0.076 

0.071* 

0.078 

0.076 

0.079 

.  0.077 

0.081 

0.078 

0.082 

0.080 

0.081* 

0.081 

0.085 

0.083 

0.087 

0.081* 

0.088 

0.086 

0.089 

0.087 

0.091 

0.088 

0.092 

0.090 

0,091* 

0.091 

0.095 

0.093 

0.097 

0.091* 

0.098 

0.096 

0.100 

0.097 

0.101 

0.098 

0.103 

0.100 

O.lOl* 

0.101 

p.io5 

0.003 

O.OOl* 

0.005 

0.006 

0.007 

0.008 

0.008 

0.010 

0.010 

0.011 

0.012 

0.013 

0.013 

0.015 

0.015 

0.016 

0.016 

0.018 

0.018 

0.020 

0.019 

0.021 

0.021 

0.023 

0.022 

0.021* 

0.021* 

0.026 

0.025 

0.027 

.990 

.995 

0.079 

0.081 

.  0.080 

0.083 

0.082 

0.081* 

0.083 

0.086 

0.085 

0.087 

0.086 

0.089 

0.088 

0.091 

0.089 

0.092 

0.091 

0.091* 

0.092 

0.095 

0.091* 

0.097 

0.095 

0.098 

0.097 

0.100 

0.098 

0.101 

0.100 

0.103 

0.102 

O.lOl* 

0.103 

0.106 

0.105 

0.107 

0.106 

0.109 

0.108 

0.110 

0.109 

0.112 

0.110 

0.113 

0.112 

0.115 

0.113 

0.117 

0.006 

0.007 

0.008 

0.009 

0.010 

0.012 

0.013 

O.Oll* 

O.Oll* 

0.016 

0.016 

0.018 

0.018 

0.019 

0.020 

0.021 

0.021 

0.023 

0.023 

0.025 

0.025 

0.027 

0.026 

0.028 

0.028 

0.030 

0.029 

0.032 

0.031 

0.033 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDE^  jE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

C  =  One-sided  confidence  level 
N  =  Sample  size 

F  =  Observed  number  of  failures  in  a  sample  of  N  trials 


N 


£  S. 

.500 

.800 

.900  ' 

.950 

15 

0.020 

0.02U 

0.027 

0.029 

0.033 

0.035 

16 

0.021 

0.025 

0.028 

0.030 

0.031* 

0.037 

17 

0.022 

0.027 

0.029  . 

0.032 

0.036 

0.038 

18 

0.023 

0.028 

0.031 

0.033 

0.037 

o.oi*o 

19 

0.025 

0.029 

0.032 

0.035 

0.039 

0.01*1 

20 

0.026 

0.031 

0.03h 

0.036 

0.01*1 

0.01*3 

21 

0.027 

0.032 

0.035 

0.038 

0.01*2 

,0.01*5 

22 

0.028 

0.03U 

0.036 

0.03? 

0.01*1* 

0.01*6 

23 

0.030  . 

0.035 

0.038 

0.01*0 

0.01*5 

0.01*8 

2U 

0.031 

0.036 

C.039 

0.01*2  , 

0.01*7 

o.ol*9 

25 

0.032 

0.038 

o.oia 

0.01*3 

0.0l*8 

n.o5i 

26 

0.033 

0.039 

0.0li2 

o.cl*5 

' 0. o5o 

0.052 

27 

0.035 

o.oUo 

0.01*3 

0.01*6 

o.o5i  . 

o.o5ii 

28 

0.036 

0.0U2 

0.0U5 

0.01*8 

0.053 

0.055 

29 

0.037 

0.0U3 

0.0U6 

0.01*9 

0.051* 

0.059 

30 

'  0.038 

o.oUii 

0.01*8 

0.051 

0.056 

0.058 

31 

O.OUO 

0.0116 

0.01*9 

0.052 

0.057 

0.060 

32 

O.OUl 

0.0U7 

o.o5o 

0.053 

0.059 

0.061 

33 

0.0U2 

0.0U8 

0.052 

0.055  , 

0.060 

0.063 

3U 

O.OU3 

0.050 

0.053 

0.056 

0.062 

0.06I* 

35 

0.0U5 

0.051 

0.055 

0.058 

0.063 

0.066 

36 

0.0U6 

0.052 

0.056 

0.058 

0.065 

0.067 

37 

0.0U7 

0.05U 

0.057 

0.060 

0.066 

0.069 

,38 

0.0U8 

0.055 

0.059 

0. 062 

0.067 

0.070 

39 

o.o5o 

0.056 

0.060 

0.063 

0.069 

0.072 

Uo 

9.051  , 

0.058 

Q.061 

0.065 

0.070 

0.073 

Ui 

0.052 

0.059 

0.063 

0.066 

.  0.072 

0.075 

U2 

0.053 

0.060 

0.061* 

0.067 

0.073 

0,076 

U3 

0.055 

0.062 

0.065 

0.069 

0.075 

0.078 

Uh 

0.  o56 

0.063 

0.067 

0.070 

0.076 

0.079 

U5 

0.057 

.  0.06U 

0.068 

0.072 

0.078 

0.081 

U6 

,  0.058 

0.066 

0.070 

0.072 

0.079 

0.082 

U7 

o,o6o 

0.067 

0.071 

0.071* 

0.081 

0.081* 

li8 

0.061 

0.068 

0.072 

0.076  , 

0.082 

0.085 

U9 

0.062 

0.069 

0.073 

0.077 

0.083 

0.086 

5o 

0.063 

0.071 

0.075 

0.078 

0.085 

0.088 

51 

0.065 

0.072 

0.076 

0.080 

0,087 

,0.089 

52 

0.066 

0.073 

0.078 

0.081 

0,088 

0.091 

53 

0.067 

0.075 

0.079 

0.083 

0,090 

0.092 

5U 

0.068 

0.076 

0.080 

O.O8I* 

0,091 

0.09li 

55 

0.070 

0.077 

0.082 

0.085 

0.092 

0.095 

56 

0.070 

0.079 

0.083 

0.037 

0.091* 

0.097 

57 

0.072 

0.080 

0.081* 

0.088 

0.095 

0.098 

58 

0.073 

0.081 

0.086 

0.089 

0.097 

0.099 

59 

0.075 

0.083 

0,087 

0.091 

0.098 

0.101 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 


C  >  One-sided  confidence  level 
N  *  Sample  size 

F  «  Observed  number  of  failures  in  a  sample  of  N  trials 


N 


15 

16 

17 

18 

19 

20 
21 
22 
23 
2U 

25 

26 

27 

28 

29 

30 

31 

32 

33 
3U 

35 

36 

37 

38 

39 
UO 
Ul 
U2 
U3 
Uli 
U5 
L6 
U7 
U8 
U9 

50 

51 

52 

53 
5U 

55 

56 

57 

58 

59 


.500 

.800 

iiQO 

0.020 

0.02U 

0.027 

0.021 

0.025 

0.028 

0.022 

0.027 

0.029 

0.023 

0.028 

0.031 

0.025 

0.029 

0.032 

0.026 

0.031 

0.03li 

0.027 

O-O32 

0.035 

0.028 

O.O3U 

0.036 

■0.030 

0.035 

0.038 

0.031 

0.036 

0.039 

0.032 

0.038 

d.oUi 

0.033 

0.039 

0.0U2 

0.035 

o.oUo 

0.0U3 

0.036 

0.0U2 

0.0U5 

0.037 

O.OU3  ' 

0.0U6 

0.038 

O.OUii 

0.0U8 

o.oUo 

O.OU6 

0.0U9 

o.oUl 

0.0U7 

o.o5o 

0.0U2 

O.OU8 

0.052 

0.0U3 

o.o5o 

0.053 

0.0U5 

0.051 

0.055 

0,0U6 

0.052 

0.056 

0.0U7 

0.05U 

0.057 

0.0U8 

0.055 

0.059 

o.o5o 

0.056 

0.060 

».05i 

0.058 

Q.061' 

0.o52 

0.059 

0.063 

0.053 

0.060 

0.06U 

0.055 

0.062 

0.065 

0.056 

0.063 

0.067 

0.057 

0.06U 

0.068 

0.053 

0.066 

0.070 

o.,o6o 

0.067 

0.071 

0.06l 

0.068 

0.072 

0.062 

0.069 

0.073 

0.063 

0.071 

0.075 

0.065 

0.072 

,0.076 

0.066. 

0.073 

0.078 

0.06t 

0.075 

0.,079 

0.068 

0.076 

0.080 

0.070 

0.077 

0.082 

0.070 

•  0.079 

.  0.083 

0.072 

,  0.080 

O.O8U 

0.073 

C.08I 

0.086 

0.p75 

0.083 

0.087 

.950 

0.029 

0.033 

0.035 

0.030 

0.03U 

0.037 

0.032 

0.036 

0.038 

0.033 

0.037 

O.oUo 

0.035 

0.039 

O.oUl 

0.036 

o.oUl 

0.0U3 

0.038 

0.0U2 

0.0U5 

0.039 

o.oUU 

0.0U6 

O.OUO 

o.oU5 

0.0U8 

O.OU2 

0.0U7 

0.0U9 

0.0U3  ■ 

0.0U8 

o.o5i 

0.0U5 

o.o5o 

0.052 

0.0U6 

0.051 

0.05U 

0.0U8 

0.053 

0.055 

0.0U9 

0.05U 

0.059 

o.o5i 

0.056 

0.058 

0.052 

0.057  ■ 

0.060 

C.053 

0.059 

0.061 

0.055 

0.060 

0.063 

0.056 

0.062 

0.06U 

0.058 

0.063 

0.066 

0.058 

0.065 

0.067 

0.060 

0.066 

0.069 

0.062 

0.067 

0.070 

0.063 

0.069 

0.072 

0.065 

0.070 

0.073 

0.066 

0.072 

0.075 

0.067 

0.073 

0.076 

0.069 

0.075 

0.078 

0.070 

0.076 

0.079 

0.072 

0.078 

0.081 

0.072 

0.079 

0.082 

0.07U 

O.O8I 

0.08U 

0.076 

0.082 

0.085 

0.077 

0.083 

0.086 

0.078 

0.085 

0.088 

0.080 

0.087 

0.089 

O.O8I 

.  0.088 

0.091 

0.083 

0.090 

0.092 

O.O8U 

0.091 

0.09U 

0.085 

0.092 

0.095 

0.087 

0.09U 

0.097 

0.088 

0.095 

0.098 

0.089 

0.097 

0.099 

0.091 

0.098 

0.101 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  Lll 


=  One-sided  confidence  level 
=  Sample  size 

=  Observed  number  of  failures  in  a  sample  of  N  trials 


1  £ 

.500 

.800 

i222 

^20 

.995 

U2 

0.  o5o 

0.057 

0.060 

0.063 

0.070 

0.072 

U3 

0.051 

0.058 

0.062 

0.065 

0.071 

0.073 

Uii 

0.053 

0.059 

.  0.063, 

0.066 

0.072 

0.075 

0.05U 

0.060 

0.061i 

0.067 

0.071* 

0.076 

U6 

0.055 

0.062 

0.065 

0.069 

0.075 

0.077 

hi 

0.056 

0.063 

0.067 

0.070 

0.076 

0.079 

U8 

0.057 

0.06U 

0.068 

0.071 

0.078 

0.080 

U9 

b.o58 

0.065 

0.069 

0.073 

0-079 

0.081 

$0 

o.o6o 

0.067 

0.071 

0.071* 

0.080 

0.083 

51 

0.061 

0.068 

0.072 

0.075 

0.082 

0.081* 

52 

0.062 

0.069 

0.073 

0.076 

0.083 

0.086 

53 

0.063 

0.070 

0.071* 

0.078 

0.081* 

0.087 

5U 

0.06U 

0.071 

0.076 

0.079 

0.086 

0.088 

55 

0.065 

0.072 

0.077 

0.080 

0.087 

0.090 

56 

0.067 

0.07U 

0.078 

0.082 

0.088 

0.091 

57 

0.068 

0.075 

0.079 

0.083 

0.090 

0.092 

58 

0.069 

0.077 

0.081 

O.08I* 

0.091 

0.091* 

59 

0.070 

0.078 

0.082 

0.085 

0.092 

0,095 

60 

0. 071 

0.079 

0.083 

0.087 

0.091* 

0.096 

6l 

0.073 

0.080 

,0.081* 

0.088 

0.095 

0.098 

62 

0.07U 

0.081 

0.086 

0.089 

0.096 

0.099 

0 

0.001 

0.002 

0.003 

0.003 

0.005 

0.006 

1 

0.002 

0.003 

o.ool* 

0,005 

0.00? 

0.008 

2 

0.003 

o.ooU 

0.006 

0.007 

0.0C9 

0.010 

3 

o.ooU 

0.006 

0.007 

0.009 

0.011 

0.012 

U 

0.005 

0.007 

0.009 

0.010 

0.013 

O.Oli* 

5 

0. 006 

0.009 

0.010 

0.012 

O.Oll* 

0.016 

6 

0.007 

0.010 

0.012 

0.013 

0.016 

0.017 

7 

0.009 

0.011 

0.013 

0.015 

0.018 

0.019 

8 

0.010 

0.013 

O.Oli* 

0.016  ■ 

0.019 

0.021 

9 

0.011 

O.Oll* 

0.016 

. O.017 

0.021 

0.022 

10 

0.012 

,  0. 015 

0.017 

0.019 

0.022 

0.021* 

11 

0.013 

0.016 

0-018 

0.020 

'  0.021* 

0.025 

12 

0.  oil*' 

0.018 

0.020 

0.022 

0.025 

0.027 

13 

'  0.015 

0.019 

0.021 

0.023 

0.027 

0.028 

11* 

0.016 

0.020 

0.022 

0.021* 

.  0.028 

0.030 

15 

0.017 

0.021 

0.021*. 

0.026 

0.030 

0.031 

16 

0.019 

0.023 

0.025 

0.027 

0.031 

0,033 

17 

0.020 

0.02li 

0.026 

0.028 

0.032 

0.03ii 

18 

•  0.021 

0.025 

0.027 

0.030 

0.03L 

0.035 

19 

0. 022 

0.026 

0.029 

0.031 

0.035 

0.037 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

C  *  One-sided  confidence  level 

N  =  Sample  size 

»  ' 

F  =  Observed  number  of  failures  in  a  sample  of  N 

trials 

it 

N  F  £ 

.500 

.800 

.950 

r. 

20 

0.023 

0.027 

0.030 

0.032 

0.037 

0. 038 

21 

0.02U 

0.029 

0.031 

0.033  ■ 

0.038 

o.oUo 

22 

0.025 

0.030 

0.032 

0.035 

0.039 

o.oUl 

'H 

23 

0.026 

0.031 

0.03U 

0.036 

o.oUl 

0.0U2 

2li 

0.027 

0.032 

0.03U 

0.037  ■ 

O.0U2 

0.0U3 

•  f- 

25 

0.029 

0.033 

0.036 

0.039 

O.0U3 

0.0U5 

1  / 

26 

O.O30 

,0.035 

0.037 

o.oUo 

0.0U5 

0.0U7 

|- 

27 

0.031 

0.036 

0.039 

o.oUi 

0.0U6 

0.0U8 

■C 

28 

0.032 

0.037 

o.oUo 

0.0U2 

0.0U7 

0.0U9 

29 

0.033 

0.038 

o.oUl 

o.oUi 

0.0U9 

0.051 

30 

0.03U 

0.039 

0.0U2 

0.0U5 

o.o5o 

0.052 

^  ■-  ^ 

31 

0.035 

o.oia 

o.oUl^ 

0.0U6 

0.051 

0.053 

32  ■ 

0.036 

0.0U2 

0.0U5 

0.0U7 

0.053 

0.055 

33 

0.037 

0.0ii3 

0.0U6 

0.0U9 

0.05U 

0.056 

.  .■  ' 

3li 

0.039 

O.OUli 

0.0U7 

o.o5o 

o.o55 

0.057 

35 

o.oUo 

0.0U5 

0.0U9 

0.051 

0.057 

0.059 

36 

o.oUi 

0.0U7 

o.o5o 

0.052 

0.058 

0.060 

**."• 

37 

O.OU2 

O.OU8 

o.o5i 

0.05U 

o.o59 

0.061  . 

'  -f’ 

38 

O.OU3 

0.0ii9 

0.052 

0.  o55 

0.061 

0.063 

^  *  •. 

39 

o.cUii 

o.o5o 

0.053 

0.056 

0.062 

0.06U 

Uo 

0.0U5 

0.051 

0.055 

0.057 

0.063 

0.065 

la 

0.0U6 

0.052 

0.056 

0.059  . 

0.06U 

0.067 

'  ‘-V 

U2 

o.oli? 

0.05U 

0.057 

0.060 

0.066 

0.068 

U3 

0.0U9 

0.055 

0.058 

0.061 

0.067 

0.069 

Uli 

o.o5o 

0.056 

0.059  . 

0.062 

0.068 

■  0.070 

0.051 

0.057 

0.061 

0.06U 

0.070 

b.0.72 

*  ’  . 

<a 

U6 

0.052 

0.058 

0.062 

0.065 

0.071 

0.073 

hi 

0.053 

0.059 

0.063 

0.066 

0.072 

0.07U 

'■  L-'  ■ 

U8 

0.05U 

0.061 

0.06U 

0.067 

0.073 

0.076 

U9 

0.055 

0.062 

0.065 

0.069 

0.075 

0.077 

'  ■•-- 

5o 

0.056 

0.063 

0.067 

0.070 

0.076 

0.078 

51 

0.O57 

0.o6U 

0.068 

0.071 

0.077  , 

0.080 

■'  ' 

52 

0.058 

0.065 

0.069 

0.072 

0.078 

0.081 

B 

.53 

0.060 

,0.066 

0.070 

0.073  , 

0.080 

0.082 

5U  . 

0.061 

0.068  ■ 

0.071 

0.075 

0.081 

0.083 

55 

0.062 

0.069 

0.073 

0.076 

0.082 

0.085 

56 

0.063 

0.070 

0.07U 

0.077 

O.O8U 

■  0.086  . 

1 

57 

0.06U 

0.071 

0.075 

0.078 

0.085 

0.087 

58 

0.065 

0.072 

0.076 

0.080 

0.086 

0.088 

59 

0.066 

0.073 

0.077 

O.08I' 

0.087 

0.090 

1 

60 

■  0.067 

0.075 

0.079 

0.082 

0.089 

0.091 

I 
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UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

C  =  One-sided  confidence  level 
N  =  Sample  size 

F  =  Observed  number  of  failures  in  a  sample  of  N  trials 


F  C  .^00 

.800 

.900 

0 

0.001 

0.002 

0.002 

0.003 

0.005 

0.006 

1 

0.002 

0.003 

O.OOli 

0.005 

0.007 

0.008 

2 

0.003 

O.OOh 

0.006 

0.007 

0.009 

0.010 

3 

o.ooU 

0.006 

0.007 

0.008 

0.011 

0.012 

k 

0.005 

0.007 

0.008 

0.010 

0.012 

0.013 

$ 

0.006 

0.008 

0.010 

0.011  ' 

O.Olli 

0.015 

6 

0.007 

0.010 

0.011 

0.012 

0.015 

0.016 

7 

.  0.008 

0.011 

0.012 

'  O.Olli 

0.017 

0.018 

8 

0.009 

0.012 

O.Olli 

0.015 

0.018 

0.019 

9 

0.010 

0,013 

0.015 

0.016 

0.020 

0.021 

10 

0.011 

o.olU 

0. 016 

0.018 

0.021 

0.022 

11 

0.012 

0.016 

0.017 

0.019 

0.022 

0.02li 

12 

0.013 

0.017 

0.019 

0.020 

0.02li 

0.025 

13 

O.Olli 

0.018 

0.020 

0.022 

0.025 

0.027 

lU 

0.015 

0.019 

0.021 

0.023 

0,027 

0.028 

15 

0. 016 

0.020 

0.022 

0.02li 

0.028 

0.029 

16 

0.018 

0.021 

0.02li 

0.025 

0,029 

0.031 

17 

0.019 

0.023 

0.025 

0.027 

0.031 

0.032 

18 

0.020 

0.02ii 

0.026 

0.028 

0.032 

0.03li 

19 

0.021 

0.025 

0.027 

0.029 

0.033 

0.035 

20 

0.022 

0.026 

0.028 

0.030 

0.035 

6.036 

21 

0.023 

0.027 

0.030 

0.032 

0.036 

0.038 

22 

0.02U 

0.028 

0.031 

0.033, 

0.037 

0.039 

23 

0.025 

0.029 

0.032 

0.03li 

0.038 

O.OliO 

2U 

0.026 

0.031 

0.033 

0.035 

O.OliO  , 

o.oia 

25 

0.027 

0.032 

0.03U 

0.037 

o.oia 

0.0li3 

26 

0.028 

0.033  • 

0.035 

0.038 

0.0li2 

O.Olili 

27 

0.029 

0.03h 

0.037 

0.039 

,  O.Olili 

o.oli5 

28 

,0.030 

0.035 

0.038 

o.oUo 

o.oli5 

0.0li7 

29 

,  0.031 

0.036 

0.039 

o.oia 

0.0li6 

O.OliS 

30 

0.032 

0.037 

O.OliO 

0.0li3 

0.0li7 

0.0li9 

31 

'  0.033 

0.038 

o.oUi 

O.Olili 

0.0li9 

o.o5i 

32 

0.03U 

.O.OliO 

0.0li2 

o.oli5 

o.o5o 

0.052 

33 

,0.035 

o.oia. 

O.Olili 

0.0li6 

0.051 

0.053 

3U 

0.036 

0.0U2 

o.oli5 

0.0li7 

0,052 

o.o5ii 

35 

0,038 

O.OU3 

0.0li6 

0.0li9 

,  0.05U 

o.o56 

36 

0.039 

o.oUU 

0.0li7  ■ 

o.o5o 

0.055 

0.057 

37 

o.oUo 

,  0.0U5 

0.0li8 

O.oSl 

0.056 

0.058 

38 

O.OUl 

0.0116 

0.0li9 

0.052 

0.057 

•  0.059 

39 

0.0ii2 

0.0U7., 

0.051 

0.053 

0.059 ' 

0.061 

UO 

0.0U3 

0.0U9 

0.052 

o.o51i 

0.060 

0.062 

Ul. 

o.oUli 

o.o5o 

0.053 

0.056 

0.061 

0.063 

k2 

0.0U5 

.  o.o5i 

0.05U 

0.057 

0.062 

0.061i 

U3 

O.OU6 

0.052 

0.055 

0.058 

0.063 

0.066 

UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE  SIDED  LIMITS 

C  =  One-sided  confidence  level 
N  «  Sample  size 

F  =  Observed  number  of  failures  in  a  sample  of  N  trials 


1  s. 

.500  ' 

.600 

.900 

,  ^ 

.995 

kk 

0.0U7 

0.053 

0.056 

0.059 

0.065 

0.067 

O.OliS 

0.051; 

0.057 

0.060 

0.066 

0.068 

U6 

0.0U9 

0.055 

0.059 

0.06l 

0.067 

0.069 

kl 

o.o5o 

0.056 

0.060 

0.063 

0.068 

0.071 

hS 

0.0^1 

0.057 

0.061 

0. 06I; 

0.070 

0.072 

k9 

0.052 

0.059 

0.062 

0.065 

0.071 

0.073 

5o 

0.053 

0.060 

0-063 

0.066 

0.072 

'0.071; 

0.051; 

0.06l 

0.061; 

.  0.067 

0.073 

0.075 

0 

0.001 

0.002 

0.002 

0.003 

o.oo5 

.  0.005 

1 

0.002 

0.003' 

O.OOl; 

0.005 

0.007 

0.007 

2 

0.003 

o.ooU 

0.005 

0.006 

0.008 

0.009 

3 

'  0.  OOi; 

0.006 

0.007 

0.008 

0.010 

0.011 

k  ■ 

o.,oo5 

0.007 

'0. 008 

0.009 

0.012 

O.013 

5 

0.006 

o.oc 

0.009 

0.010 

0.013 

O.OIU 

6 

0.007 

' 0.009 

0.011 

.  0.012 

0.015 

0.016 

7 

0.008 

0.010 

0.012 

.  0.013 

0.016 

■  0.017 

8 

0.009 

0.011 

0.013 

o.oiU 

0.017 

0.018 

9 

0.010 

0.012  , 

O.OlU 

0.016 

0.019 

0.020 

10 

0.011 

o.oiu 

0.015 

0.017 

0.620 

0.021 

11 

0.012 

0.015 

0.017 

0.018 

0.021 

0.023 

12 

0.013 

0.016 

0.018 

0.019 

0.023 

0.021; 

13 

O.Oll; 

0.017 

0.O19 

0.021 

0.021; 

0.025 

lU 

0.015 

0.018 

0.020 

0.022 

0.025 

,0.027 

15 

0.016 

0.019 

0.021 

0.023 

0.027 

0.028 

16 

0.017 

0.020 

0.022 

0.021; 

0.028 

0.029 

17 

0.018 

0.021 

0.021; 

0.025 

0.029 

0. 031 

18 

0.019 

0.022 

0.025 

0.027 

. 0.030 

0.032 

19 

0. 020 

0.021; 

0.026 

0.028 

0.032 

0.033 

20 

0.'021 

0.025 

0.027 

0.029 

0.033 

O.03I; 

21 

■  0.022  , 

0.026 

0.028 

0.030 

■0.031; 

0.036 

22 

0.023 

0.027 

0.029 

0.031 

0.035 

0.037 

23 

0.02h 

0.028 

0.030 

0.032 

.0.037 

0.038 

2U 

0.025 

0.029 

0.031 

0.03U 

0.038 

0.039 

25 

0.026 

0.050 

0.033 

0.035 

0.039 

o.oia 

26 

0.027 

0.031 

0.031; 

0.036 

0.  oUo 

0.0l;2 

27 

■  0.028 

.  0.032 

0.035 

0.037 

o.oUl 

0.0l;3 

28 

0.029 

0.033 

0.036 

0.038 

0.0i;3 

0.014; 

29 

■  0.030 

0.031;  . 

0.037 

0.039 

O.OU4 

0.0l;6 

30 

■  0.031 

0.035 

0.038 

o.ouo 

,  0.0l;5 

0.0l;7 

31 

0.032 

0.037 

0.039 

0.0l;2 

0.0l;6 

O.OUS 

UPPER  LIMITS  OF  BINOMIAL  CONFIDENCE  INTERVAL  FOR  DEFECTS:  ONE-SIDED  LIMITS 

C  »  One-sided  confidence  level 
N  =  Sample  size 

F  =  Observed  number  of  failures  in  a  sample  of  N  trials 


Z  c 

iioo 

.800 

iiQO 

ii20, 

.995 

32 

0.033 

0.038 

o.oUo  ■ 

0.0U3 

0.0U7 

0.0U9 

33 

0.03li 

0.039 

o.oia 

O.Olili 

0.0U9 

o.o5o 

3U 

0.035 

o.oUo 

0.0U3 

0.0U5 

o.o5o 

0.052 

35 

0.036 

o.oUl 

o.oUli 

0.0U6 

0.051  • 

0.053 

36  ' 

0.037 

0.0U2 

0.0U5 

0.0U7 

0.052 

0.05U 

37 

0.038 

O.OU3 

0.0U6 

0.0l;8 

0.053 

0.055 

38 

0.039 

o.oUii 

0.0U7 

o.o5o 

0.055 

0.056 

39 

,  o.oUo 

0.0U5 

0.0li8 

o.o5i 

0.056 

0.058 

Uo 

o.oUl 

0.0U6 

0.0U9 

0.052 

0.057 

0.059 

Ul 

0.0U2 

0.0U7 

o.o5o 

0.053 

0.058 

o.o6o 

U2 

0.0l;3 

0.0U8 

o.o5i 

0.05U 

0.059 

0.061 

li3 

O.OUi 

0.0U9 

0.052 

0.055 

o.o6o 

0.062 

Uli 

0.0U5 

o.o5o 

0.05U 

0.056 

o.o6i 

0.06U 

hS 

0.0U6 

0.051 

0.055 

0.057 

0.063 

0.065 

U6 

0.0U7 

0.052 

0.056 

0.058 

0.061i 

0.066 

U7 

0.0U8 

o.o51i 

0.057 

0.060 

0.065 

0.06? 

U8 

0.0li9  ■ 

0.055 

0.058 

0.061 

0.066 

0.068 

U9 

o.o5o 

0.056 

0.059 

0.062 

0.067 

0.069 

5o 

o.o5i 

0.057 

o.o6o 

0.063 

0.068 

0.071 
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Table  2  (Continued) 


11 

12 

13 

14 

15 

0  . 

.CCC 

.230 

.coc 

.CCC 

.206 

.CCC 

.193 

.OCC 

.181 

1 

.C05 

.365 

.CC4 

.339 

.004 

.317 

.CC4 

.297 

.003 

.279 

2 

.033 

.470 

.030 

.438 

.C2£ 

.410 

.026 

.386 

.024 

.363 

3 

.079 

.564 

.072 

.527 

.066 

.495 

.061 

.466 

.057 

.440 

4 

.135 

.650 

.123 

.609 

.113 

.572 

.104 

.540 

.097 

.513 

,5 

.200 

.729 

.1£1 

.684 

.166 

.645 

.153 

..6C9 

.342 

.578 

6 

.271 

.£CG 

.245 

.755 

.713 

.206 

.675 

.191 

.640 

7 

.350 

.865 

.316 

.£19 

.29,1 

.776 

.264 

.736 

.244 

.7CC 

£ 

.436 

.921 

.391 

.£77 

.355 

.834  ' 

.325. 

.794 

.300 

.756 

•  9 

.530 

.967 

.473 

.928 

.428 

.111 

.3^1 

.847 

.360 

.809 

lo 

.635 

.995 

.562 

.970 

.505 

.934 

.460  ■ 

.896 

.422 

.858 

11 

,762  1 

.CLC 

.661 

.996 

.590 

.972 

.534 

.939 

.489 

.903 

12 

.779 

l.OCO 

.683 

.996 

.614. 

.974 

.560 

.943 

13 

.794 

l.OOC 

.703 

.996 

.637 

.976 

14 

.807  1 

.COO 

.721 

.997 

15 

.819 

l.OCO 

Ly.azple:  Observed  from  sample  5/lC.  The  90^  confidence  limits  for  the  population 
are  .2:^3  aiid  ,777. 


n 

X 

16 

17 

18 

19 

20  ■ 

r 

.000 

.171 

.000 

.162 

.000 

.153 

.COC' 

.346 

.000 

.339 

1 

.003 

.264 

.003 

.250 

.003 

.238 

.003 

.226 

.003 

.216 

2 

.023 

.344 

.021 

.326 

.020 

.310 

.019 

.296 

.018 

.282 

3 

.053 

.417 

.050 

.396 

.047 

.377 

.044 

.359 

.042  . 

.344 

'  ■  4 

.090 

.484  ' 

.085 

.461 

.080 

.439 

.075 

.a9 

.071 

.401 

5  ^ 

.132 

.549 

.124 

•  522 

.116 

.498 

.110 

.476 

.104 

.455 

6 

.176 

.608 

.166 

'  ,580 

.156 

•554 

.347  . 

.529 

-7139 

.507 

7 

.227 

.667 

.212 

.636 

.199 

.608 

.188  ' 

.582 

.177 

.558 

8 

.279 

.721 

•  .260 

.6fc9 

.244 

.659 

.229 

.632 

.217 

.606 

9 

.333 

.773 

.313 

.740 

,291 

.709 

.274 

.679 

.259 

.653 

10 

.392 

.822 

.364 

.786  ■ 

.341 

.756 

.321 

.726 

.302 

.698 

11 

.451 

.868 

.420 

.834 

.392 

.601 

.368 

.771 

.347 

.741 

12 

.516 

.910 

.478 

,876 

.U6 

.eu 

.418 

.832 

.394 

.783 

13  ■ 

.583 

.947 

.539 

.915 

.5C2 

.884 

.471 

.£53 

.442 

.£23 

14 

.656 

.977 

.604 

.950 

.561 

.920 

.524 

.890 

.493 

.861 

15 

.736 

.997 

.674 

.979 

.62: 

.953 

.581 

.925 

.545 

.£96 

16 

.829  1 

.000 

.750 

.997 

.690 

.980 

.6a 

.956 

.599 

.929 

17 

.638 

1.000 

.762 

.997 

.704 

.981 

.656 

.958 

18 

.847 

1.000 

.774 

.997 

.718 

.982 

»854 

1.000 

Ibcample I  Observed  from  sample  lC/20.  The  90%  confidence  limits  for  the  population 
are  .302  and  .698, 
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22 

■  24 

26 

28 

30 

r 

0 

.000 

.127, 

.000 

.117 

.000 

.109 

.OCC 

.101 

oOCO 

.095 

1 

.002 

.198 

.002 

.183 

.002 

.170, 

.002 

.158 

.CC2 

.149 

2 

.016 

.260 

.015 

.240 

.014 

.223 

.013 

.208 

.012 

.196 

3 

.038 

.316 

.035 

.292 

.032 

.272 

.030 

.254 

.028 

.238 

4 

.065 

.370 

.059 

.342 

.054 

.318 

.050 

.297 

.047 

.280 

5 

.094 

.420 

.086 

.389 

.079 

.362 

.073 

.339 

.066 

.319 

6 

.124 

.468 

.115 

.435 

.106 

.406 

.098 

.379 

.091 

.357 

7 

.160 

.515 

.U6 

.479 

.134 

.447 

.124 

.a9 

.115 

.394 

8 

.196 

.561 

.178 

.522 

.163 

.487 

.151 

.457 

.140 

.429 

9 

.233 

.605 

.211 

.563 

.194 

.526 

.179 

.493 

.166 

.466 

10 

.271 

.647 

.246 

.603 

.226 

.564 

.208 

.531 

.193 

.499 

11 

.311  ■ 

.669 

.282 

.643 

.259 

.602 

.238 

.565 

.221 

.533 

12 

.353 

.729 

.319 

.681 

.292 

.636 

.270 

.600 

.249 

.567 

13 

.395 

.767 

.357 

.718 

.327 

.673 

.301 

.633 

.279 

.597 

14 

.439 

.604 

.397 

.754 

.362 

.708 

.333 

.667 

.308 

.630 

15 

.465 

.840 

.437 

.789 

.398 

.7a 

.367 

.699 

.339 

.661 

16 

'  .532 

.876 

.478 

.822 

.436 

.774 

.400 

.730 

.370 

.692 

17 

.560 

.906 

.521 

.654 

.474 

.806 

.435 

.762 

.403  , 

.721 

18 

.630 

.935 

.565 

.885 

.513 

.837 

.469 

.792 

.433 

.751 

19 

.684 

.962 

.611 

.914 

.553 

.866 

.507 

.821 

.467 

.779 

20 

.■740 

.984 

.658 

.941 

.594 

.894 

.543 

.849 

.501 

.807 

21 

.802 

.998 

.708 

.965 

.638 

.921 

.581 

.876 

.534 

.834 

22 

.673  1 

.000 

.760 

.985 

.682 

.946 

.621 

.902 

.571 

.860 

23 

.817 

.998 

.728 

.968 

.661 

.927 

.606 

.885 

24 

.883  1 

.000 

.777 

.986 

.703 

.950 

.643 

.909 

25 

■ 

.830 

.998 

.746 

.970 

.681 

.932 

26 

.891 

l.CCO 

.792 

.987 

.720  ■ 

.953 

27 

'  ■ 

.842 

.998 

.762 

.972 

26 

.899 

l.OCO 

.804 

.988 

29 

.851 

.998 

30 

.905 

l.CCO 

Bxamplei  Observed  from  sample  6/30.  Ihe  90%  confidence  limits  for  the  copulation 
are  .091  and  .357. 
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TWO  SIDED  90%  CONFIDENCE  LIMITS  ON  BINOMIAL  p 


n 

X 

35 

40 

0 

.000 

.082 

.000 

.072 

1 

. 

.001 

.128 

.001 

.113 

5 

.010 

.169 

.009 

.149 

3 

.024 

.206 

.021 

.183 

4 

.040  . 

.243 

.035 

.215 

5 

.058 

.277 

.051 

.245 

6 

.078 

.311 

,  .067 

.275 

7 

.098 

.343 

.085 

.304 

€ 

.119 

.374 

.103 

.331 

9 

.141 

.405 

.123 

.360 

10 

.163 

.436 

.U2 

.387 

11 

.187 

.467 

.162 

12 

.211 

.496 

.134 

.441 

13 

.235 

.524 

.204 

.466 

U 

.261 

.553 

.226 

.492 

15 

.286 

.581 

.247 

.518 

16 

.311 

.609 

.269 

.543 

17 

.337 

.636 

.292 

.567 

18 

.364 

.663 

.3U 

.592 

19 

.39.1 

.689 

.333 

.615 

20 

.41.9 

.714 

.362 

.638 

21 

.447 

.739 

.385 

.662 

22 

.476 

.765 

.408 

.686 

23 

.504 

.789  . 

.433 

.708 

.  24 

.533 

.813 

.457 

.731 

25 

■  .564 

.837 

.432 

.753 

X 

35 

40 

26 

.595  .659 

.508 

.774 

27 

.626  .881 

.534 

.796 

28 

.657  .902 

.559 

.816 

29 

.689  .922 

.586 

.338 

30 

.723  .942 

.613 

.858 

31 

.757  .960 

.640 

.877 

32 

.794  .976 

.669 

.897 

33 

.831  .990 

.696 

.915 

34 

.372  .999 

w725 

.933 

35 

.918  1,000 

.755 

.949 

36 

.785 

.965 

37 

.817 

.979 

,  38 

.851 

.991 

39 

.887 

.999 

40 

.928 

1.000 

41 

42 

43 

44 

45 

46 

, 

47 

48 

49 

50 

Example:  Observed  from  sample  35/50#  Bio  90Jt  confidence  limits  for 
the  population  are  .576  and  .805. 
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Table  2 


TWO-SIDED  90%  CONFIDENCE 


COO 


C49, 


076 

.:oi 

124 

146 

167 


5 


6  .C45  .U7. 

7  .050  .206 

6  , .066  .226 

9  .cec  .2^5 

.0  .093  .266 

1  .106  .265 

.2  .220  .304 

.3  .133  .323 

4  .147  .341 

.5  .161  .356 


X 


16 

.175 

.376 

17 

.169 

.594 

16 

.204 

.412 

19 

.216 

.429 

2C 

.233 

.U5 

21 

.246 

.463 

22 

.263 

.481 

23 

.278 

.496 

24 

.292 

.515 

25 

.309 

.530 

26 

.323 

.547 

27 

.340 

.563 

26 

.357 

.561 

29 

'  .37^ 

.597 

30 

.387 

.613 

APPENDIX 


Table  2  {Continu 


Ljcanplf, »  Observc<J  from  saitp^c  iC/lOO.  The  0O% 
arc  .414  and  .5^6. 


3 

led) 


3 


X 

76 

.679 

.£28 

77 

.690 

.638 

.702 

.846 

.712 

.854 

.723 

.863 

r.i 

.734 

.672 

.745 

.6:-:i 

£3 

.756 

.809 

64 

.767 

.697 

£5 

.779 

.905 

66 

.790 

.914 

£7. 

.601 

.921 

68 

.613 

.929 

£9 

.624 

.937 

9C 

.636 

.945 

91 

.648 

.952. 

92 

.660 

.960 

93 

.673 

.967 

94 

.665 

.973 

95 

.898 

.980 

96 

■  .911 

.906 

97 

.925 

.992 

96 

.939 

.996 

CiO 
/  ^ 

.953 

.999 

ICC 

.970 

l.COO 

confidence  limits  for  the  popxdaticn 
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APPENDIX  38 
Table  2  (Continued) 

TWO-SIDED  95%  CONFIDENCE  INTERVALS  FOR  BINOMIAL  DISTRIBUTION 

The  following  lists  the  95%  confidence  interval  for  the  binomial  distribution.  These  tables  are 
similar  to  the  90%  tables. 

TWO-SIDED  95%  CONFIDENCE  LIMITS  FOR  DEFECTS 


000  .975 

025  1.000 


2 

3 

.000 

.842 

.000 

.708 

.013 

.937 

.008 

.906 

.158  1.000 

.094 

.292 

.992 

1.000 

5 

.000 

.522 

.005 

.716 

.053 

.853 

.147 

.947 

.234 

.995 

.478 

1.000 

.  6 

7 

8 

9 

10 

.000 

.459 

,000 

.ao 

.000 

.369 

.000 

.336 

.000 

.308 

.004 

.6a 

.004 

.579 

.003 

.527 

.003 

.483 

.003 

.U5 

.043 

.777 

.037 

.710 

.032 

.651 

.028 

.600 

.025 

.556 

.118 

.882 

.099 

.816 

.085 

.755 

.075 

.701 

.067 

.652 

.223 

.957 

.184 

.901 

.157 

.843 

.137 

.788 

.122 

.,738 

.359 

.996 

.290 

.963 

.245 

.915 

.212 

.863 

.187 

.813 

1.000 

.421 

.996 

.349 

.968 

.299 

.925 

.262 

.878 

.590 

1.000 

.473 

.997. 

.400 

.972 

.348 

.933 

.631 

1.000 

.517 

.997 

.444 

.975 

.664 

1.000 

.555 

.997 

.692 

1.000 
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Table  2  (Continued) 


11 

12 

13 

H 

15 

0 

.000 

.235. 

.000 

.265 

.000 

.247 

.000 

.232 

.000 

.218 

1 

.002 

.413 

.002 

to 

• 

.002 

.360 

.X2 

.339 

.002 

.319 

2 

.023 

.518 

.021 

.484 

.019 

.454 

.018 

.428 

.017 

.405 

3 

.060 

.610 

.055 

.572 

.050 

.538 

.047 

.503 

.043 

.  .481 

4 

.109 

.692 

.099 

.651 

.091 

.614 

.084 

.581 

.078 

.551 

5 

.167 

.766 

.151 

.723 

.139 

.684 

.128 

.649 

.118 

.616 

6 

.234 

.233 

.211 

.789 

.192 

.749 

.177 

.711 

.163 

.677 

n 

.308 

.291 

.277 

.349 

.251 

.808 

.230 

.770 

.213 

.734 

s 

.390 

.940 

.349 

.901 

.316 

.361 

.289 

.323 

.266 

.787 

9 

.482 

.977 

.428 

.945 

.386 

.909 

.351 

.872 

.323 

.837 

10 

.537 

.998 

.516 

..979 

.462 

.950 

.419 

.916 

.384 

,882 

11 

.715 

l.XO 

.615 

998 

.546 

.981 

.492 

.953 

.449 

.922 

.735  1 

.000 

.640 

.998 

.572 

.982 

.519 

.957 

13 

' 

.753  l.OX 

.661 

.998 

.595 

.983 

U 

.768 

1.000 

.(;81 

.998 

15 

.782 

l.COO 

Example:  Observed  from  sample  5A0.  The  955#  confidence  limits  for  the  pop- 
on  are  .187  and  .813. 


APPENDIX  3B 


Table  2  (Continued) 


21 

22 

23 

24 

25 

0 

.000 

.161 

.000 

.154 

.000 

.148 

.000 

.142 

.000 

.137 

1 

.001 

.238 

.001 

.229 

.001 

.a9 

.001 

.211 

.001 

.203 

2 

.012 

.304 

.011 

.292 

.011 

.281 

.CIO 

.270 

0 

,030 

.363 

.029 

.349 

.028 

.336 

.027 

'  .323 

.025 

.312 

4 

.054 

.419 

.052 

.403 

.050 

.388 

.047' 

.374 

5 

.082 

.471 

.078 

.453 

.075 

.436 

.071 

.421 

.068 

.407 

6 

.113 

.522 

.107 

.502 

.102 

.484 

.098 

.467 

.094 

.451 

/* 

.146 

.570 

.139 

.549 

.132 

.529 

.126 

.512 

.121 

.494 

8 

.ICl 

.616 

.172 

.593 

.164 

.573 

.156 

.553 

.149 

.535 

9 

•  ^  .8 

.660 

.207 

.636 

.197 

.615 

.188 

.594 

.160 

.575 

10 

.257 

.702 

.244 

.678 

.232 

.655 

.221 

.634 

.211 

.6U 

11 

.298 

.743 

.282 

.718 

.268 

.694 

.256 

.672 

.244 

.651 

12 

.340 

.782 

.322 

.756 

.306 

.732 

.291 

.709 

.278 

.637 

13 

.384 

.819 

.364 

.793 

.345 

.768 

.328 

.744 

.313 

.722 

14 

.430 

.854 

.407 

.828 

.385 

.803 

.366 

.779 

.349 

.756 

15 

.478 

.887 

.451 

.861 

.427 

.836 

.406 

.812 

.386 

.789 

16 

.529 

.918 

.498 

.893 

.471 

.868 

.U7 

.844 

.425 

.820 

17 

.581 

.946 

.547 

.922 

.516 

.898 

.488 

.874 

.465 

.851 

18 

.637 

.970 

.597 

.948 

.564 

.925 

.533 

.902 

.506 

.879 

.696 

.988 

.651 

.971 

.612 

.950 

.579 

.929 

.549 

.906 

20 

.762 

.999 

.708 

.989 

.664 

.972 

.626 

.953 

.593 

.  .932 

21 

.839 

i.poo 

.771 

.999 

.719 

.989 

.677 

.973 

22 

.846  1.000 

.781 

.999 

.730 

.990 

.688 

.975 

23 

.852 

1.000 

.789 

.999 

24 

.858 

1.000 

.797 

.999 

25 

.863 

L.OOO 

Example;  Observed  from  sample  10/25.  The  95%  Confidence  limits  for  the 
ulation  are  .211  and  .614. 
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Si 

26 

28 

30 

0 

.000 

cv 

• 

.000 

.123 

.000 

.116 

1 

.001 

.197 

.001 

..184 

.001 

.172 

2 

.009 

.251 

.009 

.235 

.008 

.221 

3 

.024 

.301 

.023 

.282 

.021 

.265 

4 

.044 

.349 

.040 

.327 

.038 

.307 

5 

.066 

.393 

.061 

.369 

.056 

.348 

6 

.090 

.436 

.083 

.410 

aU  1  f 

.386 

7 

.116 

.478 

.107 

.449 

.099 

.423 

3 

.143 

.518 

.132 

.487 

.123 

.459 

9 

.172 

.557 

.159 

.524 

.148 

.494 

10 

.202 

.595 

.186 

.560 

.173 

.528 

11 

.234 

.631 

.215 

.594 

.199 

.561 

12 

.266 

.666 

.245 

.628 

.227 

.594 

13 

.299 

.701 

.275 

.661 

.255 

.626 

U 

.334 

.734 

■  .306 

.694 

.283 

.657 

15 

.369 

.766 

.339 

.725 

.313 

.687 

16 

.405 

.798 

.372 

.755 

.343 

.717 

17 

.443 

.828 

.406 

.735 

.374 

.745 

IS 

.482 

.857 

.440 

.814 

.406 

.773 

19 

.522 

.334 

.476 

,341 

.439 

.301 

20 

.564 

.910 

.513 

.868 

.472 

.827 

21 

.607 

.934 

.551 

.893 

.506 

.352 

22 

.651 

.956 

.590 

.917' 

.541 

.877 

23 

.699 

.976 

.631 

.939 

.577 

.901 

24 

.749 

.991  , 

.673' 

.960 

.614 

.923 

25 

.803 

.999 

.718 

.977 

.652 

.944 

26 

27 

23 

29 

30 

.363  1.0^30 

.765  .991 
.316  .999 
.877  1.000 

.693  .962  1 

.735  .979 

.779  .992 

.828  .999 

.884  1.000 

35 


40 


31 

32 

33 

34 

35 

36 

37 

38 

39 

40 


.000 

.100 

.000 

.088 

.001 

.U9 

.001 

.132 

,007 

.192 

.006 

.169 

.013 

.230 

.016 

.204 

.032 

.268 

.028 

.236 

.048 

.303 

.042 

.268 

.066 

.336 

.057 

.298 

.084 

.369 

.073. 

.328 

.104 

.401 

.090 

.357 

.125 

.433 

.109 

.385 

.147 

.463 

.127 

.412 

.169 

.493 

.146 

.439 

.192 

.522 

.166 

.465 

.215 

.551 

.185 

.491 

.239 

.578 

.206 

•  .517 

.263 

.607 

.227 

.542 

.288 

.634 

.249 

.567 

.3U 

.660 

.271 

.590^ 

.340 

.686 

.293 

.615 

.366 

.712 

.315 

.639 

.393 

.737 

.338 

.662 

.422 

.761 

.361 

,685 

.449 

.785 

.385 

,707 

.478 

.808 

,410 

.729 

.507 

.331 

.433 

.751 

.537 

.853 

.452 

.773 

.567 

.875 

.483 

.794 

.599 

c896 

.509 

,  .815 

.631 

.916 

.535 

.834 

.664 

.934 

.561 

.854 

.697 

.952 

.588, 

.873 

.732 

.963 

.615 

.891 

.770 

.982 

.643 

.910 

,308 

.993 

.672 

.927 

.851 

.999 

.702 

.943 

.900 

1.000 

.732 

.958 

,76^ 

.972 

.796 

.984 

.831 

.994 

,868 

.999 

.912 

1.000 

the  population  are  .458  and  .773. 
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n  =  100 


X 

0 

.000 

.036 

.000 

.054 

.002 

.070 

.006 

.035 

.011 

.099 

5 

.016 

.113 

6 

.022 

.126 

.029 

.139 

.035 

.152 

.042 

.164 

10 

.049 

.176 

11 

.056 

’.188 

12 

.064 

.200 

13 

.071 

.212 

U 

.078 

.223 

15 

.036 

.236 

16 

.094' 

.247 

17 

.102 

.258 

18 

.110 

.269 

19  ■ 

.119 

.281 

20 

.126 

.292 

21 

.135 

.303 

22 

.144 

.3U 

23 

.152 

,324 

24 

.161 

.336 

25 

.169' 

.347 

X 

26 

.177 

.357 

27 

.187 

.368 

28 

.195 

.378 

29 

.204 

.390 

— ( 

.213 

.399 

31 

.221 

.ao 

.230 

.420 

.240 

.431 

34 

.248 

.441 

35 

.257 

.452 

36 

.266 

.463 

37 

.276 

.472 

33 

.284 

,432 

39 

.294 

.493 

40 

.303 

.503 

a 

.313 

.513 

42 

.32? 

.523 

43 

.332 

,533 

44 

.3U 

.543, 

45 

.350 

.553 

46  ' 

.361 

.563 

47 

.370 

.573 

48 

.380 

.582 

49  ' 

.389 

.592 

50  , 

.393 

.602 

51 

.408 

.611 

52 

.a8 

.620 

53 

.427 

.630 

54 

.437 

.639 

55 

.447 

.650 

56 

.457 

.659 

57 

.467 

.668 

58 

.477 

.678 

59 

.487 

.637 

60 

.497 

.697 

61 

.507 

.706 

62 

.518 

.716 

63 

.528 

.724 

64 

.537 

.734 

65 

.548 

.743 

66 

.559, 

.752 

67 

.569 

,760 

63' 

.580 

.770 

69 

.59,0 

.779 

70 

,601 

'  ,787 

71 

.610 

.796 

72 

.622 

.805 

73 

.&32 

.813 

74 

,643 

.823 

75 

.653 

.831 

X 

76 

.664 

.839 

77 

.676 

.848 

78 

,686 

.856 

79 

.697 

.865 

80 

.70S 

.874 

31 

.719 

.831' 

32 

.731 

.390 

33 

.742 

.393 

34 

.753 

.906 

35 

.764 

.9U 

36' 

.777 

,922 

37 

.738 

.929 

83 

.800 

.936 

39 

.944 

90 

;951 

91 

.836 

.958 

92 

.848 

.965 

93 

.361 

.971 

94 

.374 

,973 

95 

.387 

.984 

96 

.901 

97 

.915 

,994 

Vu 

.930 

.993 

99  i 

.946 

1.000 

100 

.964 

1.000 

Example:  Observed  from  sample  50/100.  Iho  95/5  confidence  llrAts  for  the  population 
are  .398  and  .602. 
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Table  2  (Continued) 

99%  CONFIDENCE  INTERFVAL  FOR  BINOMIAL  DISTRIBUTION 

The  following  lists  the  99%  confideno;  interval  for  the  binomial  distribution.  These  tables  are 
similar  to  the  90%  tables. 

TWO-SIDED  99%  CONFIDENCE  LIMITS  FOR  DEFECTS 


ggSM 

IK&S 

1 

2 

3 

4 

5 

0 

.000 

.995 

.000  .92^; 

.000 

.829 

.000 

.734 

.000 

.653 

mU 

,005 

1.000 

.003  .  997 

.002 

.959 

.001 

.389 

.001 

.315 

2 

.071  1.000 

.oa 

.998 

.029 

.971 

.023 

.917 

3 

.171 

1.000 

.111 

,999 

;083 

.9T7 

4 

,266 

1.000 

.185 

.999 

5 

.347 

1.000 

n 

X 

6 

7 

8 

9 

10 

0 

.000 

.536 

.000 

.531 

.000 

.484 

,000 

.445 

.000 

.411 

1 

,001 

.746 

.001 

.('>85 

.001 

.632 

.001 

.585  ' 

.001 

.544 

2 

.019 

.856 

.016 

.797 

.ou 

.742 

.012 

.693 

.011 

.648 

3 

.066 

.934 

.055 

.882 

.047 

.330 

.042 

.781 

.037 

.735 

4 

.144 

.981 

.118 

.945 

.100 

.900 

.037 

,.854 

.or/ 

.809 

5 

.254 

.999 

.203 

.984 

..170 

.953 

.246 

.913 

.128 

.872 

6 

1.000 

.315 

.999 

.258 

.986 

.219 

.958 

.191 

.923 

7 

.469 

1.000 

.363 

.999 

.307 

.988 

.265 

.963 

8 

.516 

1.000 

.415 

.999 

.352 

.989 

9 

.555 

1.000 

.456 

.999 

10 

, 

.589 

1.000 

APPENDIX  3B 
Table  2  (Continued) 


11 

12 

13 

U 

15 

0 

.000 

CM 

to 

. 

.000 

.357 

.000 

.335 

.000 

.315 

.000 

.298 

1 

.000 

.509 

.000 

.477 

.000 

.449 

.000 

.4^ 

.000 

.402 

2 

.010 

.608 

.009 

.573 

.008 

.541 

.008 

.512 

.007 

.486 

3 

.033 

.693 

.030 

.655 

.028 

.621 

.026 

.569 

.024 

.561 

4 

.069 

.767 

.062 

.728 

.057 

.691 

.053 

.658 

.049 

.627 

5 

.114 

.831 

.103 

.791 

i094 

.755 

.087 

.720 

.080 

.688 

6 

.169 

.886 

.152 

.848 

.138 

.811 

.127 

.777 

.117 

.744 

7 

.233 

.931 

.209 

.897 

,189 

.862 

.172 

.828 

.159 

.795 

8 

.307 

.967 

.272 

.938 

.245 

.906 

.223 

.873 

.205 

.8a 

9 

.392 

.990 

.345 

.970 

.309 

.943 

.280 

.913 

.256 

.883 

10 

.491 

1.000 

./27 

.991 

.379 

.972 

.342 

.947 

.312 

.920 

U 

.618 

1.000 

.523 

1.000- 

.459 

.992 

.411 

.974 

.373 

.951 

12 

.643 

1.000 

.551 

1.000 

.488 

.992 

.439 

.976 

13 

.665 

1.000 

.576 

1.000 

.514 

.993 

14 

.685 

1.000 

.598 

1.000 

15 

.702 

1.000 

Example:  Observed  from  sample  5/10,  The  9956  confidence  limits  for  the 
popuOation  are  .128  and  .872. 
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SI 

i6 

17 

18  . 

19 

20 

0 

.000 

.282 

.000 

.268 

.000 

.255 

.000  .  .243 

.000 

.233 

1 

.000 

•  331 

.000  .363 

.000 

.346 

.000 

.331 

.000 

.317 

2 

.007 

.463 

.006 

.441 

.006 

.422 

.006 

.404 

.005 

.387 

3 

.022 

.53'* 

.021 

.510 

.020 

.488 

.019 

.468 

.018 

.449 

4 

.045 

.599 

.043 

*.573 

.040 

.5‘^9 

.033 

.527 

.036 

.507 

5 

.Crr5 

.658 

.070 

.631 

.065 

.605 

.062 

.582 

.0^ 

.560 

6 

.109 

.714 

.101 

.685 

.095 

.658 

.090 

.633 

.085 

.610 

7 

.147 

.764 

.137. 

•735 

.1^ 

.707 

.121 

.681 

.114 

.657 

8 

.189 

.811 

.176 

.781 

.165 

.753 

.155 

.726 

.146 

.701 

9 

.236 

.853 

.219 

.824 

.205 

.795 

.192 

.768 

.181 

.743 

10 

.286 

.891 

.265 

.863 

.247 

.335 

.232 

.808 

.218 

.782 

11 

.342 

.925 

.315 

.899 

.293 

.872 

.274 

.845 

.257 

.819 

12 

.401 

.955 

.369 

.930 

.342 

.905 

.319 

.879 

.299 

.854 

13 

.466 

.978 

.427 

.957 

.395 

.935 

.367 

.910 

.343 

.886 

l4 

.537 

.993 

.490 

*979 

.451 

.960 

.418 

.938 

.390 

.915 

15 

.619  1.000 

.559 

.994 

.512 

*980 

.473 

.96^3 

.440 

.942 

l6 

.17 

18 

19 

20 

.713  1.000 

.637  1*000  ' 
.732  1.000 

.578  .99^ 

.654  1.000 
.745  1.000 

.532  .981 
.596  .994 
.669  1.000 
.757  1-000 

.493  .964 

.551  .982 

.613  .995 

.633  1^000 
.767  1.000 

Jhfanmle!  Ohcerved  ■from  sasiDle  10/20.  The  QQi  confidence  limits  for  the  OOiJ- 
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51 

22 

24 

26 

28 

I  30 

1 

m 

.000 

,2U 

.000 

,198 

.000 

.184 

.000 

.172 

.000 

.162 

1 

.000 

.292 

.000 

.271 

.000 

.253 

.000 

.237 

oOOC 

.223 

2 

.005 

.358 

.004 

.332 

,004 

,310 

.004 

.291 

,004 

.274 

3 

.016 

.416 

.015 

,387 

,013 

.362 

,012 

.340 

,012 

.320 

4 

.032 

.470 

.029 

,438 

,027 

.410 

,025 

.385 

.023 

.363 

5 

.053 

.520 

,048 

.485 

.044 

,455 

,041 

.428 

,038 

,404 

6 

.076 

.567 

,069 

.531 

,064 

.498 

.059 

.469 

,054 

,443 

.102 

.612 

.093 

.573 

,085 

.538 

,078 

,508 

,073 

.480 

.131 

.655 

.119 

614 

,109 

.578 

,100 

,545 

,093 

,516 

.162 

.t^5 

.146 

.653 

,134 

,615 

,123 

.581 

.114 

,550 

10 

.195 

.734 

.176 

,690 

,161 

,651 

.148 

,  616 

.137 

,583 

11 

.229 

.771 

,207 

.726 

,189 

.686 

,173 

.649 

.160 

,616 

12 

.266 

.805 

,240 

.760 

..918 

,719 

,200 

.6c2 

,185 

.,647 

13 

.305 

.838 

,274 

.793 

,249 

,751 

.228 

.713 

,ai 

,678 

U 

.345 

.869 

.310 

.324 

.231 

.782, 

,257 

.743 

,237 

,707 

15 

.388 

.898 

.347 

'  .854 

.3U 

.811 

,287 

,772 

.265 

.735 

16 

.433 

.924 

,386 

.381 

.349 

.839 

,318 

,800 

,293 

.763 

17 

.430 

.947 

.427 

.907 

,385 

.866 

.351 

.827 

.322 

.789 

18 

.530 

.968 

.469 

,931 

.422 

.891 

.384 

.852 

.353 

.815 

19 

.534 

.984 

.515 

.952 

.462 

.915 

.419 

.877 

,384 

,840 

20 

.642 

.995 

.562 

.971 

.302 

.936 

,455 

.900 

.a7 

,863 

21 

.708 

1.000 

.613 

.985 ' 1 

,545 

.956 

,492 

,922  ^ 

.,450 

,886 

22 

.786 

I.CCO  , 

',668 

.996 

.590 

.973 

.531 

,941 

■  ,484 

'.907 

23 

.729 

1,000 

.638 

,987  1 

.572 

.959 

.520 

.927 

24 

.802 

i,c:o 

.690 

.996 

.615 

.975 

,557 

,946 

25 

.747 

l.COO 

.660 

.988 

.596 

.  .962 

26 

.816 

1.000 

.709 

.996 

.637 

.977 

27 

.763 

l.COO 

,680 

.988 

28 

8,28 

1.000 

.726 

.996 

29 

.777 

1.000 

30 

.838 

1.000 

Example*  Observed  from  sample  6/jC,  The  99/6  confidence  limits  for  the  pop 
ula.tlon  are  .054  and  .443. 
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Table  2  (Continued) 


35 

40 

0 

■ 

■ 

19 

1 

.COO  .194 

.CCC  .172 

19 

2 

.003  .239 

.003  .212 

|24  . 

3 

.010  .280 

.009  .249 

1 

25 

4 

.020  .318 

.017  .283 

1 

5 

.032  .354 

.028  .315 

26 

27 

6 

.046  .389 

.040  .346 

28 

7 

.062  .422 

.054  .376 

29 

8 

.079  .455 

.068  .406 

30 

9 

.097  .485 

.084  .434 

10 

.115  .516 

,100  .461 

31 

32 

11 

.135  .545 

.117  .489 

33 

12 

.156  .574 

.134  .515 

34 

13 

.177  .602 

.153  .541 

35 

U 

.198  .629 

.17?  .566 

15 

.222  .655 

.191  .539 

36 

37 

16 

.245  .681 

.211  .614 

38 

17 

.269  .706 

.231  .638 

39 

18 

.294  .731 

.252  .661 

40 

19 

.319  .755 

.273  .  .683 

20 

.345  .778 

.295  .705 

IRfl 
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Table  2  (Continued) 


S3S 

45 

50 

0 

.occ 

.111 

.000 

.101 

3 

.000 

.154 

.CCO 

.139 

2 

.002 

.190 

.002 

.173 

3 

.008 

.223 

.007 

.203 

4 

.015 

.254 

.cu 

.231 

5 

.025 

.284 

.022 

.258 

6 

.036 

.312 

.032 

to 

e 

.047 

.339 

.042 

.309 

.060 

.366 

.054 

.334 

.074 

.392 

.066 

.357 

jm 

.088 

.418 

.079 

.381 

iH 

.103 

.442 

.092 

.404 

.118 

.465 

.106 

.425 

.134 

.490 

.120 

.447 

.150 

.513 

.134 

15 

.167 

.536 

.U9 

.490 

16 

.184 

.558 

.lU 

.511 

Y7 

.202 

.580 

.180 

.532 

18 

.221 

.601 

.196 

.551 

19 

.i39 

.623 

.213 

.572 

20 

.257 

•  644 

.229 

,591 

Example  I  Observed  from  sample  35/50,  The  99%  confidence  limits 
for  the  population  are  .510  and  .851, 


.ccc 

.085 

.COG 

.117 

.002 

.U6 

.ooe 

.172 

.oil 

.195 

.:i8 

,218 

.026 

.241 

.C35 

.263 

.C45 

.223 

.055' 

.304 

■  .065 

.324 

.076 

.343 

.  C8V 

.363 

.098 

.381 

.110 

399 

.123  ' 

.418 

.135 

.437 

.148 

.454 

.160 

.472 

'  .174  , 

.489 

.187  . 

.507 

,201 

.524 

.215 

.5».0 

.228 

.557 

.24J  . 

.574 

■  .257 

.590 

.272 

.606 

.286 

.622 

.301 

.637 

.316 

.654 

.331 

.669 

.346 

.684 

.363 

.699 

.378 

.7U 

.394 

.728 

.410 

.743 

.426 

.757 

.U3 

.772 

.460 

.785 

.476 

.7^9 

.493 

.813 

.511 

.826 

.528 

.840 

.546 

.852 

.563 

.865 

.582 

.877 

.601 

'  .890 

.619 

.902 

.6>7 

.913 

.657 

.924 

.676 

.935 

.696 

.945 

.717 

.955 

.737 

.965 

.759 

.974 

.782 

.982 

.805 

.989 

.828 

.994 

.854 

.998 

.883 

1.000 

.915 

l.CCO 

,GCC  ,C5< 


.C44  .2U! 

,C51  .227 

.C58  .240 

.CC5  .251 
.072  .2fc3 

.079  .275 

.086  .286 
,093  .298 

.ICi  .310 
.109  !  .321 


.156  .388 

.164  399 


.331 

.341 

.350, 

.359 

.369 


57 

.437 

53 

.447 

59  ' 

.457 

60 

.466 

61 

.477 

62 

.436 

63’ 

.497 

64 

.507 

65 

.518 

.527 

.777 

.533 

.786 

.543 

.794 

.559 

.303 

.569 

,311 

.531 

.820 

.591 

,328 

.601 

.336 

.612 

.344 

.  622 

,352 

.633 

.860 

.644 

,868 

.656 

.876 

.667 

.8-4 

.679 

.891 

.590 

.899 

.702. 

.907 

.7U 

.914 

.725 

.921 

.737 

.923 

.749 

.935 

.760 

.942 

.773 

.949 

.786 

.956 

.798 

.962 

.811 

.968 

.824 

.974 

.837 

.979 

.851 

.984 

.865 

.989 

.830 

.993 

.395 

.997 

.911 

.999 

,  .908 

1.000 

_^8 

l.OCC 

EjcaDple:  Obcervtd  from  a^nple  5p/10D.  The  99$  confldeu  e 
pop'ilat  ion,  are  .369  and  .63 1. 
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Table  3 

CONFIDENCE  IN  INFERRING  (90%  <  p)  FOR  CiNOMIAL  DISTRIBUTION 

Tho  follo'uir.g  tables  list  the  confidence  vali:e  in  the  body  of  the  table  in 
inferring  that  90^  <  p  for  a  binonial  distribu^ion. 

These  tables  are  useful  for  answering  such  questions  as  "if  (x)  units  out  of 
a  sample  of  size  (n)  are  obsci-vod  to  have  sodo  particular  attribute,  what  confidence 
can  bo  put  in  the  statement  that  .the  true  proportion  of  the  population  hnvinr  this 
attribute  is  greater  than  90J." 

If  the  above  question  is  asked  about  mrny  different  situauions,  then  the  table 
entry  lists  the  percentage  of  situations  ia  which  p  is  actually  greater  than  90^ 

Thus,  the  tables  list  for  each  sanple  size,  n,  ano  cacr.  c -served  nur.bcr,  x, 
a  value  for  ?  such  that 

P  ,(90j^p)  =  table  entr^' 

Exariplos  are  given  on  each  table,  ‘ 


PEPvCKJTAGZ  CCNTIDCrCS  Hi  r-TERHE-'G 


■ 

2 

,3 

Bi 

5 

6 

'  7 

8 

9 

10 

0 

m 

<1 

<1 

<1 

_ 

<1 

<1 

<1 

<1 

<1 

1 

10 

<1 

<1 

<1 

<1 

<1 

<1 

<1 

2 

3 

<1 

•'i 

<1 

<1 

<1 

<1 

<1 

3 

■1 

27, 

5 

•  1 

,  -  t 

<1 

<1 

<1 

<1 

4 

r 

8 

2 

<1 

<1 

<1 

<1 

5 

■ 

‘  41 

V!  ^ 

11 

3 

<1 

<1 

<1 

6 

■ 

% 

47 

11 

4 

<1 

<1 

7 

52 

19 

5 

1 

8 

■ 

57 

23 

7 

9 

. 

61 

.  26  ■ 

10 

■Hi 

■■  n 

MM 

_ 

65  -  ' 

185 
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Table  3  (Continued) 


n 

21 

22 

23 

B 

25 

26 

27 

■  28 

29 

30 

■il5 

<1 

<1 

<1 

<1 

<1 

B| 

B 

B 

<1 

<1 

16 

1 

<1 

<1 

<1 

<1 

HI 

HI 

<1 

<1 

17 

C 

'2 

<1 

<1 

<1 

^B 

<1 

<1 

18 

15 

6 

2 

<1 

<1 

<1 

<1 

'9 

35 

17 

7 

3 

<1 

<1 

<1 

20 

64 

^  -n 

19 

9 

3 

1 

<1 

<1 

21 

89 

66 

41 

21 

10 

4 

1 

<1 

<1 

<1 

22 

90 

68 

U 

24 

11 

5 

•) 

<1 

<1 

^3 

91 

71 

46 

26 

13 

,  6 

2 

<1 

24 

92 

73 

49 

28 

U 

6 

3 

25 

. 

93 

75 

52 

31 

16 

7 

26 

94 

77 

54 

33 

18 

27 

94 

7B 

57 

35 

28 

9*^ 

80 

59 

29 

95 

82 

30 

. . _l 

' 

96 

Exanplo:  Observed  from  san;  Ic  21/24 

Confidence  in  inferring  90% <p  S  100%  is  21% 
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Tables  (Continued) 


31 

32 

33 

36 

37 

38 

39 

40 

S23 

<1 

Bl 

<1 

Bl 

<1 

<1 

<1 

<1 

24 

1 

<1 

El 

<1 

<1 

<1 

<1 

25 

3 

1 

<1 

El 

<1 

<1 

<1 

<<1 

26 

8 

4 

1 

<1 

<1 

<1 

<1 

<1 

<1 

<L 

27 

19 

9 

4 

2 

1 

<1 

<1 

<1 

<1 

28 

38 

a 

11 

5 

2 

<1 

<1 

<1 

<1 

<1 

29 

61 

40 

23 

12 

6 

2 

<1 

<1 

<1 

<1 

30 

83 

63 

42 

25 

13 

6 

3 

1 

<1 

<1 

31 

96 

84 

65 

45 

27 

15 

7 

3 

1 

<1 

32 

97 

86 

67 

47 

29 

16 

8 

4 

2 

33 

97 

87 

69 

49 

31 

17 

9 

•  4 

34 

97 

88 

71 

51 

33 

19 

10 

35 

97 

89 

73 

54 

35 

21 

36 

98 

90 

75 

56 

37 

37 

98 

90 

76 

58 

38 

98 

91 

78 

39 

98 

92 

40 

99 

Example  I  Obeonred  from  siuiple  34/36 

Conf idenoe  in  inferring  90)1  Ip  S  100)^  la  11$ 


liS 
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Table  3  (Continued) 

CONFIDENCE  IN  INFERRING  (95%  <  p)  FOR  BINOMIAL  DISTRIBUTION 

The  foUoying  tables  list  the  confidence  value  in  the  body  of  the  table  in 
inferring  that  95^<p  for  a  binomial  distribution. 

These  tables  are  useful  for  answering  such  questions  as  "il  \x)  units  out  of 
a  sanpl'e  of  size  (n)  are  observed  to  have  some  particular  a'ctribute,  what  confidence 
can  be  put  in  the  statement  that  the  true  proportion  of  the  population  having  this 
attribute  is  greater  than  95% 

If  the  above  question  is  asked  about  many  different  situations,  then  the  table 
entry  lists  the  percentage  of  situations  in  which  p  is  actually  greater  than  95%» 

Thus,  the  tables  list  for  each  sample  size,  n,  and  each  observed  number,  x, 
a  value  for  P  such  that 


P(9556^p)  =  table  entry 


Examples  are  given  on  each  table. 
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Table  3  (Continued) 


85 

90 

S76 

<1 

<1 

77 

3 

<1 

78 

6 

<1 

79 

13 

<1 

80 

25 

<1 

81 

,42 

1 

82 

62 

4 

83 

SO 

8  . 

84 

93 

16 

85  . 

99 

29 

86 

47 

'  87 

66 

88 

83 

89 

94 

90 

.  99 

K^l 

75 

80 

<66 

<1  ' 

<1 

67 

1 

<1 

68 

3 

<1 

69 

8 

<1 

70 

17 

<1 

71 

32 

<1 

72 

52 

1 

73 

'  73 

4 

74 

89 

,  10 

75 

98 

21 

76 

37 

77 

57 

78 

77 

79 

91 

80 

98 

MSSl 

95 

100 

^85 

<1 

<1 

86 

,2 

<1 

87 

5 

<1 

88 

10 

<1 

89 

20 

<1 

90 

34 

1 

91 

52 

3 

92 

71 

6 

93 

86 

13 

94 

95 

23 

95 

99 

38 

96 

56 

97 

74 

98 

88 

99 

96 

100 

99 

Example:  Observed  fi*om  sample  90/90 

Confidence  in  inferring  95^  S  P  S  100^  is  99^ 
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Table  3  (Continued) 
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Qjcample:  Observed  from  sample  90/90 

Confidence  in  inferring  955^  S  P  S  99% 


APPENDIX  3B 


Table  3  (Continued) 

CONFIDENCE  IN  INFERRING  (97%<p)  FOR  BINOMIAL  DISTRIBUTION 

The  following  tables  list  the  confidence  value  in  the  body  of  the  table  in 
inferring  that  97^ <p  for  a  binomial  distribution. 

Those  tables  are  useful  for  answering  such  questions  as  "if  x  units  out  of 
a  sample  of  size  n  are  observed  to  have  seme  particular  attribute^  what  confidence 
can  be  put  in  the  statement  that  the  true  proportion  of  the  population  having  this 
attribute  is  greater  than  97^." 

If  the  above  question  is  asked  about  many  different  situations,  then  the 
table  entry  lists  the  percentage  of  situations  in  which  p  is  actually  greater  the 
97?. 

Thus,  the  tables  list  for  each  sample  size,  n,  and  each  observed  number,  x, 
a  value  for  P  such  that 


P  (97?  ^  r'  =  table  entry. 
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Table  3  (Continued) 


Example:  Observed  from  sample  19/20 

Confidence  in  inferring  97?  <  P  5  100?  la  12? 
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Table  3  (Continued) 
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Example:  Observed  from  sample  93/95 

Confidonco  in  infoi'ring  97^  S  P  S  100^  is  55> 
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Table  3  (Continued) 

CONFIDENCE  IN  INFERRING  (99%  <  p)  FOR  BINOMIAL  DISTRIBUTION 

Tbe  following  tables  list  the  confidence  value  in  the  body  of  the  table  in 
inferring  that  99?<  p  for  a  binomial  distribution. 

These  tables  are  useful  for  answering  such  questions  as  "if  (x)  units  out 
of  a  sample  of  size  (n)  are  obccr’/ed  to  have  some  particular  attribute,  what 
confidence  can  bo  put  in  the  statement  that  the  true  proportion  of  the  populatior 
having  this  attribiite  is  greater  than  993t." 

If  the  above  question  is  asked  about  many  different  situations,  then  the 
table  entry  lists  the  percentage  of  situations  in  which  p  is  acutally  greater 
than  V9?. 

Thus,  the  tables  list  for  each  sample  size,  n,  and  each  observed  number,  x, 
a  value  for  P  such  that 

P  (995»^  p)  “  table  entry 

Examples  are  given  on  each  table. 
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Table  3  (Continued) 


Ejcaaplo:  Observed  from  sample  16/16 

Confidence  in  inferring  99%  S  P  S  lOOj  is  15% 
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Table  1 

CONFIDENCE  LIMITS  FOR  THE  EXPECTATION  OF  A  POISSON  VARIABLE 


If  c  is  the  observed  frequency  or  count  and  ra  ,  ^t.^are  the  lower  and  upper 
confidence  limits  for  its  fxpectatlon,  then  A  *3 

Pr'ni^<  :^-2« 
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Table  1 

CONFIDENCE  LIMITS  FOR  THE  EXPECTATION  OF  A  POISSON  VARIABLE 
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32,10 

14.07 

30,24 

22 

10,29 

40.70 

11.79 

37.22 

12.57 

35.60 

13.79 

33,31 

14.89 

31.42 

Ba 

23 

10.96 

42.02 

12,52 

38.48 

1303 

36.84 

14.58 

34.51 

15.72 

32.59 

23 

24 

11.65 

43.33 

13.25 

39.74 

14.09 

38.08 

15.38 

35.71 

16.55 

33.75 

24 

25 

12.34 

44.64 

14.00 

41.00 

U.85 

39.31 

16. 13 

36.90 

. 17,38 

34.92 

25 

26 

13.03 

45.94 

U.74 

42.25 

15.62 

40,53 

16.93 

38.10 

18.22 

36,08 

26 

27 

13.73. 

47.23 

15.49 

,43.50 

16.40 

41.76 

17.79 

39.28 

i.>'  « 

37.23 

27 

!  28 

u.u 

48.52 

16.24 

44.74 

17.17 

42.93 

18.61 

40.47 

19.90 

38.39 

,  28 

15.15 

49.80 

17.00  • 

45.98 

17.96 

U.19 

19.42 

41.65 

20.75 

39.54 

.  29 

1  30 

15.87 

51.08 

17.77 

47.21 

18.74 

45.40 

20.24 

42.83 

21,59 

40  .o'; 

30 

35 

19.52 

57.42 

21.64 

53.32 

22.72 

5i.a 

'24.38, 

48.68 

25.87 

« 4^ 

35 

40 

23.26  . 

63.66 

25.59 

59.36 

26.77 

57.35 

23.53, 

54.47 

30.20 

52.07 

40 

45 

27.08 

69.83 

29.60 

65.34 

3C.:-:3 

63.23 

32.32 

60.21 

34.56 

57.09 

45 

50 

30.96 

75.94 

33.66 

71.27 

35.03 

69.07, 

■  37.11 

65.92 

38.96 

63.29 

50 

If  c  Is  the  observed  freq'iency  or  co'int  and  m  ,  rR,,are  the  lower  and  upper 
confidence  limits  for  its  expectation,  m,  then  A 

l-2« 
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APPENDIX  3E 


Table  lA 


F  DISTRIBUTION:  UPPER  10  PERCENT  POINTS 


V| 

1 

2 

3 

B 

1 

39.864 

49.500 

53.593 

55.833 

2 

8.5263 

9.1618 

9.2434 

3 

5.5383 

3.4624 

5.3908 

5.3427 

4 

4.5448 

4.3246 

4.1908 

4.1073 

5. 

4.0604 

3.779/ 

3.6195 

3.5202 

6 

3.7760 

3.4633 

3.2688 

3.1808 

7 

3.5394 

3.2574 

3.0741 

2.9605 

8 

3.4579 

3.1131 

2.9238 

2.SO64 

o 

/ 

3.3603 

2. 8129 

2.6927 

10 

3.2850 

2.9245 

2.7277 

2.6053 

11 

3.2252 

2.8595 

2.6602 

2.5362 

12 

3.1765 

2.8068 

2.6055 

2.4801 

13 

3.1362 

2.7632 

2.5603 

2.4337 

U 

3.1022 

2.7265 

2.5222 

2.39/J 

15 

3.0732 

2.6952 

2.4898 

2.3614 

16 

3.0431 

2.6682 

2.4618 

2.3327 

17 

3.0262 

2.6446 

2.4374 

2.3077 

13 

3.0070 

2.6239 

2.a60 

2.2858 

19 

2,9899 

2.6056 

2.397c 

2.2663 

20 

2.9747 

2.5893 

2.3801 

2. 2489 

21  ■ 

2.9609 

2.5746 

2.3649 

2.2333 

22' 

2.9486 

2,3512 

2,2193 

23  . 

2.9374 

2.5493 

2.3387 

2.2065 

24 

2.9271 

2.5383 

2.3274 

2.1949 

25  ■ 

2.9177 

2,3170 

2.1843 

26 

2.9091 

2.51‘91 

2.3075 

2.1745 

27 

2.9012 

2.5106 

2.2987 

2.1655 

28 

2.3939 

2,2906 

2,1571 

29 

2.8871 

2,2831 

2.1494 

30 

2.8807 

2.4887 

2.2761 

2.1422 

40 

2.8354 

2.4404 

2.2261 

2.0909 

60 

2.7914 

2.3932 

2.1774 

2.oao 

120  ' 

2.7478 

2.3473 

2.1300 

1.9923 

O 

2,7055 

2.3026 

2.0838 

1.9449 

5 

6 

B 

8 

9 

57.241 

58.204 

59.439 

59.858 

9.2926 

9.3255 

9.3491 

9.3668 

9.3805 

5.3092 

5.2847 

5.2662 

5.2517 

5.2400 

4.0506 

3.9549 

3.9357 

3.4530 

3.4045 

3.3679 

3.3393 

3.3163 

3.1075 

3.0546 

3.0U5 

2.9830 

2.9577 

2.8833 

2.8274 

2.7849 

2.7516 

2.7247 

2.7265 

2.6683 

2.62a 

2.5893 

2.5612 

2.6106 

2.5509 

2.5053 

2.4694 

2.4403 

2.5216 

2.4606 

2.4140 

2.3772 

2,3473 

2.4512 

2.3891 

2.3a6 

2.3040 

2.2735 

2.3940 

2.3310 

2.2828 

2.2U6 

2.2135 

2.3467 

2.2830 

2.23a 

2.1953 

2.1633 

2.3069 

2.1931 

2.1539 

2.1220 

2.2730 

2.2081 

2.1582 

2.1185 

2. 0362 

2.2438 

2.1783 

2.1230 

2. 0380 

2.0553 

2.2183 

2.1524 

2.1017 

2.0613 

2.0284 

2.1958 

2.1296 

2.0785 

2.0379 

2.0047 

2.1760 

2.1094 

2.O5SC 

2.0171 

1.9836 

2.1532 

2.0913 

2.0397 

1.9985 

1.9649 

2.1423 

2.0751 

2.0232 

1.9819 

1.9480 

2.1279 

2.0605 

2.0084 

1.9666 

1.9327 

2.1149 

2.0472 

1.9949 

1.9531 

1.9169 

2.1030 

2.0351 

1.9826 

1.9407 

1.9063 

2.0922 

2.02a 

1.97U 

1,9292 

1.8947 

2.0822 

2.0139 

1.9610 

1. 9188 

1,38a 

2.073c 

2.0045 

1.9515 

1.90vl 

1.8743 

2.0645 

1.9959 

1.9427 

1.9001 

1.8652 

2.C5(^ 

1.9878 

1.9345 

1.8918 

1.8568 

2.0492 

1.9803 

1.9269 

i.ssa 

1.3490 

1.9968 

1.9269 

1.8725 

1.8289 

1.7929 

1.9457 

1.8747 

1.8194 

1.774s 

1.7330 

1.8959 

1.8238 

1.7675 

1.7220 

1.6843 

1.8473 

1.77a 

1.7167 

1.6702 

1.6315 

This  table  gives  tho  values  of  F  for  which  Ij,  (Vj ,  Vj)  -  0,10 
Cno»sidod  90  percent  tost.  , 


Two-sided  CO  percent  tost. 
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APPENDIX  3E 


Table  IB 


F  DISTRIOUTION:  UPPER  10  PERCENT  POINTS 


\V| 

vv 

10 

12 

15 

20 

24 

30 

40 

60 

120 

oo 

1 

SO, 195 

60.705 

61.220 

61,740 

62.C02 

62.265 

62.529 

62.794 

63.061 

63.323 

2 

?.3916 

9,4081 

9.4247 

9.4413 

9.4496 

9.4579 

9.4663 

9.4746 

9.4829 

9.4913 

3 

5.2304 

5.2156 

5.2003 

5.1845 

5.1764 

5.1681 

5.1597 

5.1512 

5.1425 

5.1337 

4 

3.9199 

3.8955 

3.8689 

3.8443 

3.8310 

3.8174 

3,8036 

3.7896 

3.7753 

3.7607 

5 

3.2974 

3.2682 

3.2380 

3.2067 

3.1905 

3.17a 

3.1573 

3.U02 

3.1228 

3.1050 

6 

2.9369 

2,9047 

2.8712 

2.8363 

2.8183 

2.8000 

2.7812 

2.7620 

2.7423 

2.7222 

7 

2.7025 

2,6681 

2.6322 

2.5947 

2.5753 

2.5555 

2.5351 

2.5142 

2.4928 

2.4708 

8 

2.5380 

2,5020 

2.4642 

2.4246 

2.40a 

2,3830 

2.3634 

2.3391 

2.3162 

2.2926 

9 

2.a63 

2,3789 

2.3396 

2.2983 

2.2768 

2.2547 

2.2320 

2.2085 

2.1843 

2.1592 

.TO 

2.3226 

2.2841 

2.2435 

2.2007 

2.1784 

2.1554 

2.1317 

2.1072 

2.0818 

2.0554 

11 

2.2482 

2.2087 

2.1671 

2.1230 

2. 1000 

2.0762 

2.0516 

2.0261 

1.9997 

1.9721 

12 

2.1878 

2.1474 

2.1049 

2.0597 

2.0360 

2.0115 

1.9861 

1.9597 

1.9323 

1.9036 

13 

2.1376 

2.0966 

2.0532 

2.0070 

1.9827 

1.9576 

1.9315 

1.9043 

1.8759 

1.8462 

U 

2.0954 

2.0537 

2.0095 

1.9625 

1.9377 

1.9119 

1.8852 

1.8572 

1.8280 

1.7973 

15 

2.0593 

2.0171 

1.9722 

1.9243 

1.8990 

1.8728 

1.8454 

1.8168 

1.7867 

1.7551 

16 

2.0281 

1.9854 

1.9399 

1.8913 

1.8656 

1.8388 

1.8108 

1.7816 

1.7507 

1.7182 

17 

2. 0009 

1.9577 

1.9117 

1.8624 

1.8362 

1.8090 

1.7805 

1.7506 

1.7191 

1.6856 

18 

1.9770 

1.9333 

1.3868 

1.8368 

1.8103 

1.7827 

1.7537 

1.7232 

1.6910 

1.6567 

19 

1.9557 

1.9117 

1.8647 

1.8142 

1.7873 

1.7592 

1.7298 

1.6988 

1.6659 

1.6308 

20 

1.9367 

1.8924 

1.8449 

1.7938 

1.7667' 

1.7382 

1.7083 

1.6768 

1.6433 

1.6074 

21 

1.9197 

1.8750 

1.8272 

1.7756 

1.7481 

1.7193 

1.6890 

1.6569 

1.6228 

1.5862 

22 

1.9043 

1.8593 

1.8111 

1.7590 

1.7312 

1.7021 

1.6714 

1.6389 

1,6042 

1.5668 

23 

1.8903 

1.8450 

1.7964 

1.7439 

1.7159 

1.6864 

1.6554 

1.6224 

1.5871 

,1.5490 

24 

1.8775 

1.8319 

1.7831 

1.7302 

1.7019 

1.6721 

1.6407 

1.6073 

1.5715 

1.5327 

25 

1.8658 

1.8200 

1.7708 

1,7175 

1.6890 

1.6589 

1.6272 

1.5934 

1.5570 

1.5176 

26 

3 .8550 

1.8090 

1.7596 

1.7059 

1.6771 

1.6468 

1.6147 

1.5805 

1.5437 

1.5036 

27 

1.8451 

1.7989 

1.7492 

1.6951 

1.6662 

1.6356 

1.6032 

1.5686 

1.5313 

1.4906 

28 

1.8359 

1.7895 

1.7395 

1.6852 

1.6560 

1.6252 

1.5925 

1.5575 

1.5198 

1.4784 

29 

1.8274 

1.7808 

1.7306 

1.6759 

1.6465 

1.6155 

1.5825 

1.5472 

1.5090 

1.4670 

30 

1.8195 

1.7727 

1.7223 

1.6673 

1.6377 

1.6065 

1.5732 

1.5376 

1.4989 

1.4564 

40 

1.7627 

i.-^uo 

1.6624 

1.6052 

1.57a 

i.5ai 

1.5056 

1.4672 

1.4248 

1.3769 

60 

1.7070 

1.6574 

1.6034 

1.5435 

1.5107 

1.4755 

1.4373 

1.3952 

1.3476 

1.2915 

120  , 

1.6524 

1.6012 

1.5450 

1.4821 

1.4472 

1.4094 

1.3676 

1.3203 

1.2646 

1.1926 

(D 

1.5987 

1.5458 

1.4871 

1.4206 

1.3832 

1.3a9 

1.2951 

1.2400 

1.1686 

1.0000 

"  ^  V|St 

Or  Redded  90  pereeot  test* 
Tuo-elded  80  percent  teat. 
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APPENDIX  3E 
Table  2A 


F  DISTRIBUTION:  UPPER  5  PERCENT  POINTS 


2 

3 

4 

5 

6 

7 

8 

199.50 

215-71 

224.58 

230.16 

233.99 

236.77 

238.88 

240.54 

19.000 

19.164 

19.247 

19.296 

19.330 

19.353 

19.371 

19.385 

9.5521 

9.2766 

9.1172 

9.0135 

.9406 

8.8868 

8.845: 

8.8123 

6.9U3 

6.59U 

6.3883 

6.2560 

6.1631 

6.0942 

6.cac 

5.9988 

3  *7801 

5.4095 

5.1922 

5.0503 

4.9503 

4.8759 

4.818.) 

4.7725 

5.1433 

4.7571 

4.5337 

4.3874 

4.2839 

4.2066 

4.1468 

4.0990 

4.7374 

4.3468 

4.1203 

3.9715 

3.8660 

3.7870 

3.7257 

3.6767 

4.4590 

4.0662 

3.8378 

3.6875 

3.5806, 

3.5005 

3.4381 

3.3831 

4.2565 

3.8626 

3.6331 

3.4817 

3.3738 

3.2927 

3.2296 

3.1789 

4.1C28 

3.7033 

3.4730 

3.3258 

3.2172 

3.1355 

3.0717 

3.02C4 

3.9823 

3.5874 

3.3567 

3.2039 

3.0946 

3.0123 

2.9480 

2.8962 

3.8853 

3.4903 

3.2592 

3.1059 

2.9961 

2.9134 

2.8486 

2.7964 

3.3Ci:b 

3.4105 

3.1791 

3.0254 

2.9153 

2-8321 

2.7669 

2.7144 

3.7389 

3.3439 

3.1122 

2.9582 

2.8477 

2.7642 

2.6987 

2.6458 

3.6323 

3.2874 

3.0556 

2.9013 

2.7905 

2.7066 

2.64O8 

2.5876 

3.6337 

3.2389 

3.006? 

2.8524 

2.7413 

2.6572 

2.5911 

2.5377 

3.5915 

3.1968 

2.9647 

2.8100 

2.6937 

2.6143 

2.5480 

2.4943 1 

3.5546 

3.1599 

2.9277 

2,7729 

2.6613 

2.5767 

2.5102 

2.4563 

3.5219 

3.1274 

2.8951 

2.7401" 

2.6283 

2.5435 

2.4768 

2.4227 

3.4928 

3.0984 

2.8661 

2.7109 

2.5990 

2.5140 

2.4471 

2.3928 

3.4668 

3.0725 

2.8401 

2.6848 

2.5727 

2.4876 

2.4205 

2.3661 

3.4434 

3.0491 

2.8167 

2.6613 

2.5491 

2.4638 

2.3965 

2.3419 

3.4221 

3.0280 

2.7955 

2.6400 

2.5277 

2.4422 

2.3748 

2.3201 

3.4C28 

3.0088 

2.7763 

2.6207 

2.5082 

2.4226 

2.3551 

2.3002 

3.3852 

2.9912 

2.7587 

2.6030 

2. 4904 

2.4047 

2.3371 

2.2821 

3.3690 

2.9751 

2.7426 

2.5868 

2.47a 

2.3883 

2.3205 

2.2655 

3.35a 

2;9604 

2.7278 

2.5719 

2.4591 

2.3732 

2.3053 

2.2501 

3 .3404 

2.9467 

2.7La 

2.5581 

2.4453 

2.3593 

2.2913 

2.2360 

3.3277 

2.9340 

2.7CU 

2.5454 

2.4324 

2.3463 

2.2782 

2.2229 

3.3158 

2.9223 

2.6896 

2.5336 

2.4205 

2.3343 

2.2662 

2.2107 

3.2317 

2.8387 

2.6060 

2.4495 

2.3359 

2.2490 

2.1802 

2.1240 

3.1504 

2.7581 

2.5252 

2.3683 

2.2540 

2.1665 

2.0970 

2.0401 

3.0718 

2.6802 

2.4472 

2.2900 

2.1750 

2.0867 

2.0164 

1.9588 

2.9957 

2.6049 

2.3719 

2.2U1 

2.0986 

2.0096 

1.9384 

1.8799 

Thia  table  gives  tho  values  of  F  for  which  Iy(V|  ,V2)sK5.05. 
One-sided  95  percent  test. 


Twc<>sided  90  percent  test. 


241  <,88 

19o396i 

8o7855 

5o9644 

4.7351 

4.. ^‘!6CC 
3 o 63 65 
3 o 3472 
3.1373 

2. . 9782 
2.8536 
2  ..7534 
2.671C 
2.6021 
2 .5437 
2.4935 
2,4499 
2,4117 
2,3779 
2.3479 
2,3210 
2,2967 
2.2747 
2.2547 
2.2365 
2.2197 
2. 2043 
2,1900 
2,1768 
2.1646 
2.0772 
1.9926 
1.9105 
1.8307 


243,91 
19.413 
8.7446 
5 .9117 
4.6777 
3,9999 
3.5747 
3  ..2840 
3  ;.'729 
2,9130 
2.7876 
2,6866 
2,6037 
2,5342 
2,4753 
2,4247 
2,3807 
2,3421 
2,3080 
2.2776 
2.2504 
2.2258 
2^2036 
2.1834 
2.1649 
2.U79 
2.1323 
2,1179 
2,1045 
,  2,0921 
2.0035 
1.9174 
1.8337 
1.7522 


APPENDIX  3E 
Table  28 

F  DISTRIBUTION:  UPPER  5  PERCENT  POINTS 


245.95 
19.429 
8.7029 
5,8578 
4,6188 
3.9381 
3,5108 
3 .2184 
3,0061 
2,8450 
2,7186 
2,6169 
2.5331 
2,4630 
2,4035 
2,3522 
2.3077 
2.2686 
2.2341 

2,2033 

2,1757 

2.1508 

2,1282 

2,1077 

2,0889 

2,0716 

2,0558 

2.0411 

2.0275 

2.CU8 

1.9245 

1,8364 

1.7505 

1.6664 


248,01 
19  .U6 
8.6602 
5.8025 
4,5581 
3.8742 

3 .4445 
3.1503 
2.9365 
2.7740 
2,6464 

2,5436 

2,4589 

2.3879 

2,3275 

2,2756 

2,2304 
2,1906 
2,1555 
2,1242 
2,0960 
2.0707 
2. 0476 
2.0267 
2,0075 
1,9898 
1,9736 
1,9586 
1.9446 
1.9317 
1.8389 
1.7480 
1.6587 
1.5705 


249,05 

19,454 

8,6385 

5.7744 

4,5272 

3.8415 

3,4105 

3.1152 

2.9005 
2,7372 
2.6090 
2.5055 

2,4202 

2,3487 

2.2878 

2,2354 

2.1898 

2,U97 

2,1141 

2,0825 

2,0540 

2,0283 

2,0050 

1.9838 

1.9643 

1,9464 

1.9299 

1,9U7 

1.9005 
1,8874 

1.7929 

1.7001 

1.6084 

1.5173 


250,09 
19,462  1 
6.6166 

5.7459 

4.4957 

3-3082 

3.3753 
3 .0794 
2,8637 
2.69';>6 
2,5705 
2,4663 
2,3803 
2.3082 
2,2463 

2.1933 

2.U77 

2.1C5’1 

2.0712 

2,0391 

2.0102 

1.9842 

1.9605 

1,9390 

1.9192 

1.9010 

1.8842 

1.8687 

1.8543 

1.8409 

1.7444 

1.6491 

1.5543 

1.4591 


251.14 

19.471 

8.59U 

5.7170 

4.4633 

3.7743 

3.3404 

3.0423 

2,3259 

2.6609 

2,5309 

2,4259 

2.3392 

2.2664 
2.2043 
2.1507 
2. 1040 
2.0629 
2.0264 
1.9938 
1.9645 
1.9360 

1.9139 

i.892C 

1.8718 

1.8533 

1.8361 

r,8203 

1.8055 

1.7918 

1.6928 

1.5943 

1.4952 

1,3940 


252.2c 


254.32 

19,496 
8.5265 
5.6281 
4.3650 
3,6688 
3,2298 
2.9276 
2.7C67  i 

2.5379 

2,4045 

2,2962 

2,2064 

2,1307 

2.0658 

2,'CC96 

1.9604 

1,9168 

1,8780 

1,8432 

1,8117 

1,7831 

1,7570 

1.7331 

1.7110 

li69C6 

1.6717 

1.6541 

1.6377 

1.6223 

1.5089 

1.3893 

1,2539 

1.0000 


0ne>8ided  95  percent  test 
Tuo~sided  90  percent  test 


APPENDIX  3E 


Table  3A 


F  DISTRIBUTION:  UPPER  2.5  PERCENT  POINTS 


1 

2 

3 

4 

5 

6 

7 

8 

9 

1 

6.47.79 

799.50 

864.16 

899.58 

9a. 85 

937.11 

948.22 

956.66 

963.28 

2 

38.506 

39.000 

39.165 

39.  a8 

39.298 

39.331 

39.355 

39.373 

39.387 

3 

17.443 

16.044 

15.439 

15.101 

14.885 

14.735 

14.624 

14.540 

14.473 

4 

12.2’ 8 

10.649 

9.9792 

9.6045 

9.3645 

9.1973 

9.07a 

8.9796 

8.9047 

5 

7 

8.4336 

7.7636 

7.3879 

7.1464 

6.9777 

6.8531 

6.7572 

8.6810 

6 

b.uii^l 

7.2598 

6.5988 

6.2272 

5.9876 

5.8197 

5.6955 

5.5996 

5.5234 

7 

8.0727 

6.5a5 

5.8898 

5.5226' 

5.2852 

5.1186 

4.9949 

4.8994 

4  -1232 

8 

7.5709 

6.0595 

5.a60 

5.0526 

4.8173 

4.651? 

4.52S6 

4.4332 

4.3572 

9 

7.2093 

5.7147 

5.0781 

4.7181 

4.48U 

4.3197 

4.1971 

4.102c 

4.02601 

10 

6.9367 

5.4564 

4.8256 

4.4683 

4.2361 

4.0721 

3.9498 

3.8549 

3.7790 

11 

6.72a 

5.2559 

4.6300 

4.2751 

4.0440 

3.8807 

3.7586 

3.6638 

3.5879 

12 

6.5538 

5.0959 

4.4742 

4.1212 

3.8911 

3.7283 

3.6065 

3.5118 

3.4358 

13 

6.a43 

4.9653 

4.3472- 

3.9959 

3.7667 

3.6043 

3.4827 

3.3830 

3.3120 

14 

6.2979 

4.8567 

4.2a7 

3.8919 

3.6634 

3.5014 

3.3799 

3.2853 

3.2093 

15 

6.1995 

4.7650 

4.1528 

3.8043 

3.5764 

3.a47 

3.2934 

3.: 987 

3.1227 

16 

6.1151 

4.6867 

4.0768 

3.7294 

3.50a 

3.3406 

3.a94 

3.1.”48 

3.0488 

17 

6.0420 

4.6189 

4.0112 

3.6648 

3.4379 

3.2767 

3.1556 

3. 0610 

2.9849 

18  ~ 

5.9781 

4.5597 

,3.9539 

3.6083 

3.3820 

3.2209 

3.0999 

3. 0053 

2,9291 

19 

5.9a6 

4.5075 

3.9034 

3.5587 

3.3327 

3.1718 

3.0509 

2.9563 

2,8800 

20 

5.8715 

4.4613 

3.8587 

3.5147 

3.2891 

3.1283 

3. 0074, 

2.9128 

2.8365 

21 

5.8266 

4.a99 

3-8188 

3.4754 

3.2501 

3.0895 

2.9686 

2.8740 

2.7977 

22 

5.7863 

4.3828 

3.7829 

3.4401 

3.1’151 

3.0546 

2.9338 

2.8392 

2.7628 

23 

5.7498 

4.3492 

3.7505 

3.4083 

3. 1335 

3.0232 

2.9024 

2.8077 

2.7313 

24 

5.7167 

4.3187 

3.7ai 

3.3794 

3.1548 

2.9946 

2.8738 

2.7791 

2.7027 

25 

5.6864 

4.2909 

3.6943 

3.3530 

3.1287 

2.9685 

2.6478 

2.7531 

2.6766 

26 

5.6586 

4.2655 

3.6697 

3.3289 

3.1048 

2.9U7 

2.8240 

2.7293 

2.6528 

27 

5.6331 

4.2421- 

3.6472 

3.3067 

3.0828 

2.9228 

2.80a 

2.7074 

2.6309 

28 

5.6096 

4.2205 

3.6264 

3.2863 

3.0625 

2.9027 

2.7820 

2.6OT2 

2.6106 

29 

5.5878 

4.2006 

3.6072 

3.2674 

3.0/J8 

2.8840 

2.7633 

2.6686 

2.5919 

30 

5.5675 

4.18a 

3.5894 

3.a99 

3.0265 

2.8667 

2*7460 

2.6513 

2.5746 

40 

5.4239 

4.0510 

3.4633 

3.1261 

2.9037 

2.7444 

2.6238 

2.5289 

2.4519 

60 

5.2857 

3.9253 

3.3425 

3.0077 

2.7b63 

2.6274 

2.5068 

2.ai7 

2.33  , 

120 

5.1524 

3.8046 

3.2270 

2.8943 

2.6740 

2.5154 

2.3948 

2.2994 

2.22i7 

00 

5.0239 

3.6889 

3.1161 

2.7858 

2.5665 

2.4082 

2.2875 

2.1918 

2.1136 

This  table  gives  the  values  of  F  for  wiicb  ^  (v,  -  0.025. 


One-sided  97.5  percmt  test. 
Two-sided  95<0  percent  test. 
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F 


,:68.63 
9o398 
4  c  419 
;-8439 
6192 
,4613 
,7611 


976.71 
39c415 
14.337 
8,7512 
6.5246 
5. 3662 

4.6658 


984-67 

39.431 

14.253 

8.6565 

6,4277 

5.2687 

4.5678 


,2951  4.1997 
,  9639  3  8682 


4.1012 

3.7694 


,7168 

,5257 

1.3736 

1.2497 


,0602 


.9862 

.9222 

.8664 

,8173 

.7737 


,7348 
.6998 
.6682 
,6396 
.6135 
.5895 
.5676 
.5473 
.  5286 
.5112 
.3882 
.2702 
.1570 
.0483 


3.6209 

3.4296 

3.2773 

3.1532 

3.0501 

2.9633 

2.8890 

2.8249 

2.7689 

2,7196 

2,6758 

2.6368 

2.6017 

2.5699 

2.5412 

2.5149 

2.4909 

2.4688 

2.4484 

2.4295 

2.a20 

2.2882 

2.1692 

2.0548 

1.9U7 


3. 5a? 
3.3299 
3,1772 
3,0527 
2.9493 

2.86a 

2.7875 
2,7230 
[  2.6667 
2,6171 
2,5731 
2.5338 
2,4984 
2.4665 

2.4374 

2.4110 

2.3867 

2.3644 

2.3438 

2.3248 

2.3072 

2.1819 

2.0613 

1.9450 

1.8326 


APPENDIX  3E 


Table  38 


IBUTION:  UPPER  2.5  PERCENT  POINTS 


20 

24 

- - , 

30 

40 

60 

120 

CO 

993.10 

997,25 

1001,4 

1005. 6 

1009. 8 

1014,0 

1018,3 

39.456 

39.465 

39.473 

39.481 

39.490 

39.498 

14.167 

14.124 

14,081 

14.037 

13.992 

13.947 

13.902 

8.5599 

8.5109 

8.4613 

8.4111 

8.3604 

6.3092 

8.2573 

6.3285 

6.2780 

6.2269 

6.1751 

6.1225 

6.0693 

6,0153 

5,1684 

5,1172 

5,0652 

5.0125 

4.9589 

4.9045 

4.8491 

4.4667 

4.4150 

4.3624 

4.3089 

4.2544 

4.1989 

4.1423 

3.9995 

3.9472 

3.8940 

3.8398 

3.7844 

3.7279 

3.6702 

3.6142 

3,5604 

3,5055 

3.4493 

3.3918 

3,3329 

3.a86 

3.3654 

3.3110 

3.2554 

3,1984 

3.1399 

3.0798 

3,2261 

3.1725 

3.1176 

3.0613 

3. 003 5 

2.9441 

2.8828 

3.0728 

2.9633 

2. 9063 

2.8478 

2.7874 

2.7249 

2.9477 

2.8373 

2.7797 

2.7204 

2.6590 

2.5955 

2.8437 

2.7324 

2.6742 

2.6142 

2.5519 

2.4872 

2,75:9 

2.7006 

2.6437 

2.5850 

2.5242 

2.4611 

2.3953 

2.6808 

2,6252 

2.5678 

2.5085 

2.4471 

2.3163 

2.6158 

2.5598 

2.5021 

2.4422 

2.3801 

2.3153' 

2.2474 

2.5590 

2.5027 

2.4445 

2.3842 

2.3214 

2.2558 

2.1669 

2.5089 

■2.4523 

2,3937 

2.332^' 

2.2695 

2.2032 

2.1333 

2,4645 

2.4076 

2.3486 

2.2873 

2.2234 

2.1562 

2.0853 

2.4247 

2.3675 

2.3082 

2.2465 

2.1819 

2.1141 

2.0422 

2.3890 

2.3315 

2.2718 

2.2097 

2.1446 

2.0760 

2.0C32 

2.3567 . 2.2989 

2.2389 

2.1763 

2.1107 

2.0415 

1.9677 

2.3273 

2.2693 

2.2090 

2.1460 

2.0799 

2.0099 

1.93n 

2.3CC5 

2.2422 

2.1816 

2.1183 

2.0517 

1.9811 

1.9C55 

2.2759 

2.2174 

2.1565 

2.0928 

2.0257 

1.9545 

1.8781 

2,2533 

2.1946 

2.1334 

2.C693 

2.C018 

1.9299 

1.8527 

2.2324 

2.1735 

2.1121 

2 .0477 

1.9796 

1.9072 

1.3291 

2.2131 

2.1540 

2.0923 

2.0276 

1.9591 

1.8861 

1.8072 

2.1952 

2.1359 

2.0739 

2.CC89 

1.8664 

1.7867 

2.0677 

2.0069 

1.9429 

1.8752 

1.8028 

i.7242 

1.6371 

1.9U5 

1.8817 

1.8152 

1.7U0 

1.6668 

1.5810 

1.4822 

1.8249 

1.7597 

1.6899 

1.6141 

1.5299 

1.4327 

1.3104 

1.7085 

il^ 

1.5660 

iBsa 

1.3883 

1.2684 

l.OCOO 

One-dided  97.5  percent  teat. 
Tuo-alded  95.0  percent  teat. 


APPENDIX  3E 


Table  4A 


F  DISTRIBUTION;  UPPER  1  PERCENT  POINTS 


1 

2 

3 

4  . 

5 

6 

“T 

t 

8 

9 

1 

4052.2 

4999.5 

5403.3 

5624.6 

5763.7 

5859.0 

5928.3 

5981.6 

6022,5 

2 

98.503 

99.CC0  . 

99.166 

99.249 

99.299 

99.332 

99.356 

99.374 

99.386 

3 

34.116 

30.817 

29.457 

28.710 

28.237 

27.911 

27,672 

27.489 

27.345 

4 

21.198 

18. COO 

16.694 

15.977 

15.522 

15.207 

14.976 

14.799 

14.659 

16.258 

13.274 

12.060 

11.392 

10.967 

10.672 

10.456 

10,289 

10,158 

13.745 

10.925 

9.7795 

9.1463 

8.7459 

8.4661 

8.26CO 

8.1016 

7,9761 

12.246 

9.5466 

8.4513 

7.8467 

7.4604 

7.1914 

6.9928 

6.8401 

6,718'^ 

!  ^ 

11.259 

6.6491 

7.5910 

7. 00 60 

6.6318 

6.3707  . 

6.1776 

6.0289 

5 -91061 

r- 

i 

10.561 

8.0a5 

6.9919 

6.4221 

6.0569 

5.8018 

5.6129 

5.4671 

5.3511 

II- 

10.044 

7.5594 

6.5523 

5.9943 

5.6363 

5.3858 

5.20C1 

5.0567 

4.9424 

11 

9.6460 

7.2057 

6.a67 

5.6663 

5.3160 

5.0692 

4.8861 

4.7U5 

4.6315 

12 

9.3302 

6.9266 

5.9526 

5.4119 

5.0643 

4.8206 

4.6395 

4.4994 

4.3875 

13, 

9.0738 

6.7010 

5.7394 

5.2053 

4.8616 

4.6204 

4.4410 

4.3021 

4.1911 

14 

8.8616 

6.5149 

5.5639 

5.0354 

4.6950 

4.4558 

4.2779 

4.1399 

4.0297 

8.6831 

6.3589 

5.4170 

4.8932 

4.5556 

4.3183 

4.1415 

4.CC45 

3.8948 

16 

8.5310 

6.2262 

5.2922 

4.7726 

4.4374 

4.2016 

4.0259 

3.8896 

3.7804 

17 

8.3997 

6.1121 

5.1850 

4.6690 

4.3359 

4.1C15 

3.9267 

3.791C 

3.6822 

IS 

6.2854 

6.0129 

5.0919 

4.5790 

4.2479 

4.0146 

3.8406 

3.7054 

3.5971 

19 

8.1850 

5.9259 

5.0103 

4.5003 

4.1708 

3.9386 

3.7653 

3.6305 

3.5225 

20 

8.0960 

5.8489 

4.9382 

4.4307 

4.1C27 

3.8714 

3.6987 

3.5644 

3.456'1 

a 

8,0166 

5.7804 

4.8740 

4.3688 

4.0421 

3,.  81 17 

3.6396 

3. 5056 

3.39611 

22 

7.9454 

5.7190 

4.8166 

4.3134 

3.9880 

3.7583 

3.5867 

3.4530 

3.3458 

23 

7.8811 

5.6637 

4.7649 

4.2635 

3.9392 

3.7102 

3.529C 

3.4057 

3  -  rf-ss 

24 

7.8229 

5.6136 

4.7181 

4.2184 

3.8951 

3.6667 

3 .4959 

3.3629 

3.2560 

i  25 

7.7698 

5.5680 

4.6755 

4.1774 

3.8550 

3.6272 

3.4568 

3,.  3239 

3..':172 

i  26 

7.7213 

5.5263 

4.6366 

4.1400 

3.8183 

3.5911 

3.4210 

3.2884 

, 3.1818 

27 

7.6767 

5.4881 

4.CCC9' 

4.1056 

3.7848 

3.5580 

3.3882 

3.2558 

3.1494 

2S 

7.6356 

5.4529 

■4.5681 

4.0740 

3.7539 

,3.5276 

3.3581 

3.2259 

3.1195 

29 

7.5976 

5.4205 

4.5378 

4.0U9 

3.7254 

3.4995 

3.33C2 

3.1982 

3. 0920 

30 

7.5625 

,  5.3904 

4.5097 

4.0179. 

3.6990 

3.4735 

3.3045. 

3.1726 

3.0665 

40 

7.3141 

5.1785 

4.3126 

3.8283 

3.5138 

3.2910 

3.1238 

2.9930 

2.8876 

60 

7.0771 

4.9774 

4.1259 

3.6491 

3.3389 

3.1187 

2.9530 

2.8233 

2.7185 

120 

6.8510 

4.7865 

3.9493 

3.4796 

3.1735 

2.9559 

2.7918 

2.6629 

2.5586 

dO 

6.6349 

4.6052 

3.7816 

3.3192 

3.0173 

2.8020 

2.6393 

2.5113 

2.4073 

This  t*ble  elves  the  values  of  F  for  which  IpCv^Vg)  =  0.01. 


One-sided  99  percent  test. 
Two-sided  9^  percent  test. 
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APPENDIX  3E 


Table  4B 


F  DISTRIBUTION:  UPPER  1  PERCENT  POINTS 


V>Sv 

10 

12 

15 

20 

24 

30 

-0 

60 

120 

00 

1 

6C55«S 

6106,3 

6157,3 

6208,7 

6234  6' 

6260,7 

6286  8 

6313,0 

6339.4 

6366,0 

2 

99,399, 

99,  a6 

99.432 

99, U9 

99,458 

99,466 

99,474 

99,483 

99..491 

3 

27,229 

27,052 

26,872 

26,690 

26,598 

26,505 

26. ai 

26,316 

26,221 

4 

Mia 

14,374 

14,198 

14,020 

13,929 

13,838 

13.745 

■13,652 

13.558 

13,463 

5 

ifiHssa 

9,8883 

9,7222 

9.5527 

9.4665 

9,3793 

9.2912 

9.2020 

9,1118 

9,0204 

6 

7,8741 

7  7183 

,7.5590 

7,3958 

7.3127 

7,2285 

7.1432 

■7.0568 

6,9690 

6 -8801 

7 

6,6201 

6,4691 

■  6,3143 

6,1554 

6,0743 

5,9921 

5.9084 

5.8326 

5.7572 

5.6495 

8 

5,8143 

5,6668 

5,5151 

5,3591 

5,2793 

5.1981 

5.1156 

5,0316 

4.9460 

4,8588 

9 

5,2565 

5,1114 

4.9621 

4,8080 

4.7290 

4,6486 

4.5667 

4.4831 

4.3978 

4,3105 

10 

4,8492 

4,7059 

4  5582 

4,4054 

4.3269 

4.2469' 

4.1653 

4.0819 

3.9965 

3.9090 

11 

4,5393 

4,3974 

4,2509 

4,0990 

4.0209 

3,9411 

3.8596 

3.7761 

3,6904 

3.6025 

12 

4,2961 

4,1553 

4.0C96 

3,8584 

3-7805 

3. 7008 

3.6192 

■3.5355 

3.U94 

3.3608 

13 

4,1003' 

3,9603 

3,8154 

3,6646 

3,5868 

3.5070 

3.4253 

3.3413 

3.2548 

3  >.  54 

14 

3,9394 

3,8CC1 

3,6557 

3,5052 

3.4274 

3,3476 

3.2656 

3.1813 

3.0942 

3 .CC4O 

15 

3,8049 

3.6662 

3.5222 

3.3719 

3,2940 

3.2141 

3.1319 

3.0471 

2.9595 

2.8684 

16 

3,6909 

3,5527 

3-4089 

3.2588 

3.1808 

3,1007 

3.0162 

2.9330 

2.84.- 7 

2.7528 

17 

3,5931 

3,4552 

3.3117 

3.1615 

3.0835 

3.0032 

2.9205 

2.8348 

2.745‘ 

2,6530 

IS 

3. 3706 

3.2273 

3.0771 
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Table  1 

Upper  90-  and  95-Percent  Confidence  Bounds  fcr  the  Number  cf  DefectiTi 
in  a  Finite  lopulation  of  40  Members. 


Number  of 


Sample  Size 


Observed 

2 

4, 

8 

16 

32 

Defectives 

90 

95 

90 

,  55 

90 

95 

90 

95 

90 

95 

0 

26 

30 

16 

20 

9 

11 

4 

5 

1 

1 

1 

37 

38 

26 

29 

15 

17 

7 

8 

2 

3 

2 

40 

40 

33 

35 

20 

22 

10 

31 

4 

4 

3 

38 

39 

25 

27 

15 

14' 

5 

6 

4 

40 

40 

29 

31 

16 

17 

7 

7 

5 

33 

34 

18 

20 

8 

9 

o 

36 

37 

21 

22 

9 

10 

7 

39 

39 

23 

24 

11 

'  11 

8 

40 

40 

25 

27 

12 

13 

9 

■ 

28 

29 

13 

14 

10 

30 

31 

15 

15 

11 

32 

33 

16 

16 

12 

34 

35 

17 

18 

13 

36 

37 

18 

19 

14.. 

38 

38 

20 

20 

15 

39 

39 

21 

21 

16 

40 

40 

22 

23 

17 

23 

24 

18 

25 

25  . 

19 

• 

26 

26 

20 

' 

,  27 

27 

21 

' 

28 

29 

22 

29 

30 

23 

31 

31 

24 

32 

32 

25 

33 

33 

26 

34 

34 

27 

35 

35 

28 

36 

36 

29 

■ 

37 

37 

3b 

' 

38 

38 

31 

39 

39 

32 

■ 

' 

40 

40 
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Table  2 

Upper  and  95~Percent  Confidence  Bounds  for  the  Number  of  Defectives 
in  a  Finite  Population  of  60  Members. 


APPENDIX  3H 


Table  2  (Continued) 

Upper  90-  and  95-Percent  Confidence  Bounds  for  the  Number  of  Defectives 


in  A  Finite  Population  of  60  Members. 


Nijnber  of 

Observed 

Defectives 

Sample  Size 

3 

6 

12 

24 

48 

90 

95 

9C 

95 

90 

'  95 

90 

95 

90 

95 

a 

56 

57 

29 

30 

22 

58 

58 

30 

31 

23* 

' 

59 

59 

31 

32 

24 

60 

60 

33 

33 

25 

34 

34 

26 

35 

36 

27 

36 

37 

28 

37 

38 

29 

39 

39 

30 

■ 

40 

40  , 

31 

' 

41 

'  42 

32 

42 

43 

33 

44 

U 

,34 

45 

45 

35 

46 

46 

APPENDIX  3H 


Tabl*»4 

Upper  90-  anil  95-Percent  Confidence  dounda  for  the  Nuaber  of  Defectives 
in  a  Finite  Fo^  r*  itlon  of  200  Members. 


Humber  of 


S'jnple  Size 


Observed 

10 

20 

40 

80 

160 

Defectives 

90 

95 

90 

95 

90 

95 

90 

95 

90 

95 

0 

40 

50 

20 

26 

10 

12 

4 

5 

1 

1 

1 

66 

77 

34 

a 

17 

20 

8 

9 

3 

3 

2 

88 

ICC 

47 

54 

23 

,27 

11 

13 

4 

5 

3 

109 

120 

59 

66 

30 

34 

14 

16 

5, 

6 

4 

128 

138 

70 

78 

36 

40 

17 

19 

7 

8 

5 

145 

154 

81 

89 

42 

46 

20 

22 

8 

9 

6 

161 

169 

91 

99 

47 

52 

23 

25 

10 

10  ■ 

.  7 

176 

181 

102 

109 

53 

58 

26 

28 

11 

12 

8 

188 

192 

112 

119 

58 

63 

29 

31 

12 

9 

197 

198 

121 

128 

64 

69 

31 

34 

14 

10 

200 

200 

131 

137 

69 

74 

34 

37 

15 

■a 

11 

146 

74 

80 

37 

40 

16 

17 

12 

149 

155 

80 

85 

40 

42 

18 

19 

13 

157 

163 

85 

90 

42 

45 

19 

20 

14 

165 

170 

90 

95 

45 

48 

20 

21 

15 

173 

178 

95 

100 

48 

51 

22 

23 

16 

181 

184 

100 

105 

50 

53 

23 

24 

17 

168 

190 

105 

lie 

53 

56 

22 

23 

18 

194 

196 

110 

115 

56 

59 

26 

27 

19 

198 

199 

115 

120 

58 

61 

27 

28 

20 

2C0 

200 

120 

125 

61 

64 

28 

29 

21 

' 

125 

129 

64 

67 

30 

31 

22  . 

' 

129 

134 

66 

69 

31 

32 

23 

134 

,139 

69 

72 

32  . 

33 

24 

139 

U3 

71 

74 

34 

35 

25 

143 

148 

74 

77 

35 

36 

26 

U8 

152 

77 

80 

36 

37 

27 

157 

157 

79 

82 

37 

39 

28 

161 

82 

85 

39 

40 

29 

h  161 

165 

84 

87 

40 

a 

30 

1 

I  lb*’) 

169 

87 

90 

a 

45 

31 

170 

173 

89 

92 

43 

32 

174 

177 

92 

95 

u 

45 

33 

178 

181 

94 

97 

45 

46 

34 

182 

185 

97 

ioc 

47 

48 

35 

186 

188 

• 

99 

102 

48 

49 

4 
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Table  5 

Upper  9C-  ard  95-  Pcrcer.t  Coriidfrcr  Bo’inls  :'or  the  Nir.Ler  of  Defects 
ir  2  Finite  Po-'l-itior.  of  Ueroers. 
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Table  6 


■Upper  90-  and  95-  Percent  Confidence  Bounds  for  the  Nsr.brr  of  Defectives 
in  a  Finite  Population  of  3CC  Manbers. 


Nunber  of 


Defect ives  I  90 


Sample  Size 


APPENDIX  3H 


Table? 

Upper  9C-  and  95-  Percent  ConliJence  Bounds  for  the  Number  of  Defectives 
in  a  Fin'.'. e  Population  of  360  Kenbers. 


288 

95 

90 

95 

5 

1 

1 

9 

3 

3 

13 

4 

5 

16 

5 

6 

19 

7 

8 

22 

8 

9 

25 

10 

10 

28 

11  , 

12 

31 

12 

13 

34 

U 

15 

37 

16 

40 

43 

46 

49 

52 

54 

57 

60 

63 

65 

68 

71 

74 

76 

79 

82 
84 
87 
•  90 
92 

95 

98 

ICC 

103 

106 


43 
.  44 
45 


5 
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Tables 

Uppei  90-  and  95-Percent  Confidence  Bounds  for  the  Number  of 


Defectives  in  a  Finite  population  of  4OO  Members. 


4 
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Tables 

Uppei’  90—  and  95-Fercent  Confidence  Bounds  for  tho  Number  of 
Defectives  in  a  Finite  Population  of  5CC  Members . 


Number  of 

Observed 

Defectives 

Sample  Size 

25 

50' 

100 

200 

90 

95 

90 

95 

90 

95 

90 

95 

90' 

0 

42 

55 

27 

10 

13 

4 

5 

1 

1 

72 

£6 

43 

17 

21 

8 

9 

3 

■  2 

98 

113 

58  • 

24 

28 

11  , 

13 

4 

3 

122 

138  ■ 

71 

30 

35 

14 

16 

5 

4 

145 

162 

84 

37 

42 

17 

19 

7 

5  ' 

168 

185 

86 

96 

43 

48 

20 

22 

8 

6 

190 

207 

98 

109 

49 

r  t 

23 

26 

10 

7 

211 

229 

no 

120, 

55 

60 

26 

29 

11 

£ 

232 

249 

121 

132  , 

60 

66 

29 

32 

12 

9 

252 

269 

132 

143 

66 

72 

32 

35 

14 

10 

272 

289 

U3 

155 

72 

78 

35 

38 

15 

n 

291 

308 

154 

166 

78 

84 

37 

17 

12 

310 

327 

165 

176 

83 

90 

43 

18 

13 

329 

345 

175 

187 

89 

95 

46 

19 

14 

348 

363 

186 

198  ■ 

94 

101 

49 

21 

15 

366 

380 

196 

208 

107 

o 

52 

22 

16 

383 

397 

207 

219 

105 

112 

51 

55 

23 

17 

400 

a3 

217 

229 

111 

118 

54 

58 

25 

18 

417 

428 

227 

239 

116 

123 

57 

60 

26 

19 

433 

U3 

237 

250 

121 

129 

60 

63 

27 

20 

448. 

457 

247 

260 

127 

134 

62 

66 

29 

21 

463 

470 

257 

270 

132 

65 

69 

30 

22 

477 

482 

267 

279 

137 

145 

68 

31 

23 

489 

492 

277 

289 

143 

150 

70 

32 

24 

497 

499 

287 

299 

148 

156 

73 

34 

25  ' 

500 

297 

309 

153 

161 

76 

80 

35 

26 

307 

318 

159 

166 

79 

82 

36 

27 

' 

316 

327 

164 

172 

81 

85 

38 

28 

326 

337 

169 

177 

84 

88 

39 

29 

335 

346 

174 

182 

87 

91 

40 

30 

345 

355 

179 

187 

89 

93 

42 

31 

354 

364 

185 

193 

92 

.96 

43 

32 

363 

373 

190 

198 

94 

99 

44 

33 

372 

382 

195 

203 

97 

101 

46 

34 

381 

391 

200 

208 

104 

47 

35 

, 

390 

4C0 

205 

213 

1  102 

107 

4G 

400 


95 


1 

3 

5 

6 
8 
9 

10 

12 

13 

15 

16 

17 

19 

20 
22 

23 

24 
26 

27 

28 

30 

31 

32 
34 

,  35 
36 

38 

39 

40 

42 

43 

U 

46 

47 

48 
50 
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FACTORIAL  TREATMENT  PROCEDURE  WORKSHEETS 

Table  1 


L  TP■£AT^*!1^TS  AM)  8  ITI>*S 
Design:  l/2  X  2^  (Ref.  15,  page  484) 


Treatments 

Item  numbers 

1 

2 

3 

4 

5 

f 

o 

7 

A 

■ 

■ 

■ 

■ 

■ 

B 

■ 

■ 

H 

W 

C 

O 

;z 

■ 

H 

1 

D 

■ 

H 

■ 

Bi 

Bi 

H 

Bi 

Results 

■ 

ij^nm 

■ 

■ 

■ 

■ 

■ 

Remarks: 

1.  All  main  effects  are  clear  of  two-factor  interactions. 

2.  Tuo-factor  interact  ions  .are  confused  with  one  another 
and  are  not  measurable. 

3.  Three-factor  and  higher  order  interactions  are  asstmed 
negligible. 
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Table  2 

5  TREATMENTS  AM)  8 


Remarks  t 

1.  All  main  effects  are  confi 
actions. 

2.  All  interactions  are  ass'jii 


23 


ITI>S 

,  page  484) 
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Table  3 

6  TPEAntENTS  AND  8  ITEMS 
Design  I  1/8  X  2®  (Raf.  15,  page  485) 


Treatment  a 

A 

B 
C 
D 
E 
F 

Results 
Remarks i 

1.  All  main  effects  are  confused  with  two-factor  inter¬ 
actions. 

2.  All  interactions  are  assumed  negligible. 


Item  numbers 


1 

2 

3 _ i 

4 

5 

6 

7 

■j 

B 

■ 

B 

B 

B 

■I 

B 

■ 

NONE 

■ 

■ 

^9 

B 

IB 

B 

■ 

Bi 

Bi 

B 

B 

■ 

■ 

B 

B 
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Table  4 

7  TREAPCENtS  AID  8  ITOlS 
Design  I  1/16  I  2^  (Ref.  15,  page  485) 


Trea^ents 

Item  nuabers 

1 

2 

4 

5 

6 

7 

8 

A 

+ 

•f 

+ 

+ 

B 

+ 

+ 

+ 

+• 

C 

+ 

+ 

+ 

+ 

0 

+ 

+  ■ 

+ 

s 

+ 

♦ 

f 

-  + 

■f 

■f 

+ , 

Q 

♦ 

+ 

Results 

Remarks! 

1.  All  main  effects  are  confused  with  two-factor  Inter¬ 
actions. 

2.  All  Interactions  are  assumed  negllgibls. 
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Tables 

7  TREATMERTS  AND  8  ITiyS 
Design:  M'oltifactorial  (Ref.  5,  page  323) 


Treatment  s 

A 

B 
C 
D 
E 
F 
G 

Results 
Remarks: 

1.  All  main  effects  are  confused  with  interactions. 

2.  All  interactions  arc  assuned  negligible. 


Item  ntmbers 


1 

2 

3 

4 

_ 

.6 

7 

in 

WM 

■ 

■ 

D 

■ 

H 

■ 

■ 

H 

■ 

■ 

1 

H 

■ 

■ 

H 

g 

■1 

o 

z 

+ 

+ 

+ 

+ 

+ 

+ 

+ 

+ 

+ 

+ 

•f 

V 
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APPENDIX  4 


Table  8 

TO  TRTATMF.WTS  AND  12  ITE3S 
Designs  Multifactorlsd  (Ref.  5»  page  323) 


2.  All  interact jcna  are  assuned  negligible. 
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Table  9 


11  TREATKEOTS  AND  12 


Deslgst  Mult Ifacto rial  (Ref.  5*  pags  323} 


It  an  ntxibers 


treatment  s 

1_ 

2 

4 

p 

6 

7 

8 

9 

10 

A 

+ 

4 

4 

4 

B 

+ 

+ 

4 

4 

4 

C 

+ 

4 

4 

4 

D 

+ 

+ 

4 

4 

4 

E 

+ 

+ 

♦ 

4 

4 

4 

g 

F 

3 

+ 

+ 

•f 

4- 

4 

+ 

G 

+ 

+ 

4 

4- 

.  4 

H 

+ 

+ 

+ 

4 

I 

+ 

4 

4  • 

J 

+ 

+ 

+ 

4 

4 

K 

+ 

+ 

4 

4 

4 

Result a 

1 

■ 

■ 

1 

1 

■ 

■ 

■ 

■ 
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Table  11 

5  TREAWEflTS  AND  16  ITaC 


Design*  1/2  12®  (Ref.  6,  page  5) 


Item 

nuBbers 

Treatments 

1 

2 

3 

4 

5 

6 

7 

8 

[7" 

10 

n 

I2J 

13 

1 

16J 

A 

+ 

+ 

Bl 

IB 

■ 

a 

B 

B 

■ 

B 

+ 

+ 

+ 

+ 

+  ' 

+ 

+ . 

+ 

C 

NONE 

+ 

+ 

+ 

+ 

+ 

+ 

D 

+ 

+ 

+ 

+ 

♦ 

+ 

* 

E 

+ 

•f 

+ 

+ 

+ 

* 

+ 

Blocks 

I 

II 

III 

Tf 

Results 

1 

1_ 

□ 

Remarks i 


1.  All  main  effects  are  clear  of  two>factor  Interactions. 

2.  When  blocks  are, not  used,  all  two^factor  interactions 
are  measured^le . 

When  blocks  are  used,  interactions  4B,  AC,  and  BC  are 
not  measurable. 

3.  All  three-factor  and  higher  order  interactions  are  con¬ 
sidered  negligible. 


ArrENDiX  4 
Table  12 

6  TREATKEin'S  AQ  16  TTiyS 
Design j  1/4  X  2®  (Factorial  (Ref.  6,  page  18) 


Treatr^ents 

Item  nmhe 

rs 

1 

2 

4 

r 

'  t 

7 

8 

o 

1C 

11 

...2 

13 

I 

U 

15 

16 

• 

A 

+ 

+ 

+ 

+ 

+ 

+ 

+ 

B 

+ 

+ 

+ 

+ 

+ 

+ 

+ 

•f 

C 

+ 

+ 

+ 

+ 

■  + 

♦ 

+ 

+ 

' 

D 

z 

+ 

+ 

+ 

+ 

+ 

+ 

E 

+ 

+ 

+ 

+ 

+ 

+ 

F 

♦ 

+ 

+ 

+ 

♦ 

+ 

Blocks 

I 

II 

Results 

r 

□ 

□ 

□ 

Reriarka  i  '  . 

1.  Ill  m«ln  effects  are  clear  of  two-factor  interactions. 

2.  All  two-factor  Interactions  are  confused  with  one  another 
and  are  not  measurable. 

3.  All  three-factor  and  higher  order  Interactions  are  assume 
negligible. 
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Table  13 
6  TREATMEOTS  A?iD  16 

Design:  1/4  X  2®  Factcrial  (Ref.  6,  page  18) 


Treatments 

It^ 

numbers 

1 

4 

n 

6 

7 

8 

1C 

11 

12 

13 

u 

15 

16 

A 

+ 

+ 

■ 

1 

1 

B 

fl 

■ 

■ 

Bj 

■ 

fl 

B 

■ 

B 

+ 

+ 

B 

1 

B 

1 

H 

1 

B 

1 

■ 

B: 

c 

+ 

+ 

H 

B 

B 

fl 

H 

fl 

B 

fl 

m 

HB 

D 

a 

+ 

+ 

fl 

1 

B 

B 

^1 

D 

fl 

fl 

fl 

E 

+ 

+ 

B 

B 

1 

1 

H 

H 

1 

F 

+ 

+ 

B 

fl 

1 

1 

fl 

HI 

1 

Bi 

B 

■ 

B 

B 

Blocks 

I 

II 

III 

IV 

Result  s 

— 

Refliarks  i 

1.  All  Bain  effects  are  clear  of  tvo-fector  interactions. 

2.  All  two-factor  interactions  are  confused  with  ons  another  and 
are  not  neasiirable. 

3. '  All  three-factor  and  higher  order  interactions  are  ass’ined 

negligible. 
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Table  14 

6  TPJIATMETJTS  AITl  16  im^S 
Design!  1/4  X  2®  Factorial  (Ref.  6,  page  18) 


Treatments 

Item,  numbers 

1 

2  i 

8 

9 

1C 

11 

11 

m 

16 

A 

■ 

1 

I 

B 

1 

B 

1 

B 

■ 

■ 

B 

9 

■ 

+• 

B 

1 

B 

1 

fl 

B 

■ 

I 

H 

+ 

C 

H 

1 

1 

1 

B 

B 

1 

B 

H 

B 

■ 

9 

B 

+ 

o 

■ 

D 

ss 

B 

i 

1 

D 

1 

1 

B 

B 

H 

■ 

B 

B 

B 

+ 

E 

+ 

+ 

+ 

B 

fl 

B 

9 

+ 

F 

+ 

+ 

+ 

B 

fl 

■1 

1 

B 

9 

B 

+ 

Blocks 

I 

II 

ni 

IV 

m 

B 

VII 

VIII 

Results 

.J 

J 

■ 

B 

■ 

■ 

B 

IB 

B 

■ 

Rcrarka i 

1.  All  main  effects  are  clear  of  two-factor  Interactions. 

2.  All  two-factor  interactions  are  confused  with  one  another 
and  are  not  ireasurable. 

3.  '  All  three-factor  and  higher  order  Interactions  are  as¬ 

sumed  negligible. 


appendix  4 
Table  15 

7  TBE4TVF.OTS  AKD  l6  ITOC 
Design:  1/8  I  2-  Factorial  (Ref.  6,  pa^e  iU) 


Treatments 

Itea  numbers 

1 

4 

6 

7 

8 

10 

11 

12 

1? 

14. 

1? 

16 

A 

+ 

+ 

+ 

+ 

♦ 

♦ 

+ 

+ 

B 

+ 

+ 

+ 

+ 

+ 

+ 

+ 

C 

+ 

+ 

+ 

+ 

♦ 

■f 

+ 

+ 

D 

NONE 

+ 

+ 

+ 

+ 

+ 

+ 

•f 

+ 

E 

+ 

♦ 

+ 

+ 

+ 

+ 

+ 

+ 

F 

+ 

+ 

+ 

+ 

+ 

+ 

+ 

G 

+  ■ 

+ 

+ 

+ 

■f 

♦ 

+ 

+ 

Blocks 

I 

II 

Results 

J 

□ 

□ 

Rg^arks : 


1.  ill  main  effects  are  clear  of  two-factor  interactions. 

2.  All  two-factor  interactions  are  confused  with  one 
another  and  are  not  measurable. 

3.  All  three-factor  and  higher  order  interactions  are 
aseiaed  negligible. 
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Table  16 

7  TRFAmKTS  km  16  Iin-S 
Design:  1/3  Z  2^  Factorial  (Ref.  6,  page  30) 


Treatments 

Item  nranbers 

1 

2 

r 

3 

4 

5 

6 

7 

c 

9 

10 

11 

12 

].3 

14 

15 

16 

A 

+ 

+ 

+ 

+ 

— 

.  + 

+ 

+ 

+ 

E 

+ 

+ 

+ 

+ 

+ 

+ 

+ 

+  ■ 

c 

+ 

+ 

+ 

+ 

+ 

+ 

+ 

■D 

g 

o 

+ 

+ 

+ 

+ 

+ 

+ 

+ 

+ 

z 

E 

+ 

+ 

■  + 

+ 
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Remarks  I 

1.  All  main  elfects  are  clear  of  two-factor  interactions, 

2.  All  two-factor  interactions  are  confused  with  one  another 
and  are  not  measvirable. 

3.  All  three-factor  and  higher  order  interactions  are  as¬ 
sumed  negligible. 
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Table  17 

8  TREATHElfTS  AND  16  ITD« 

Designt  l/lb  X  2^  Factorial  (Ref.  6,  page  42) 
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1.  All  aaln  effects  are  clear  of  two-factor  interactions. 

2.  All  two-factor  interactions  are  confused  with  one  another  and 
are  not  measurable. 

3*  All  three-factor  and  hi^er  order  interactions  are  assumed 
negligible. 
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2.1  TREATMENTS  ANP  16  ITEMS 
Design:  Multifactorial  (Ref.  5,  page  323) 


Item  numbers 
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Remarks: 

1.  All  main  effects  are  confused  with  interactions. 

2.  All  interactions  are  asstnned, negligible. 
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Table  21 

12  TREATKECTS  AND  16  ITEf^S’ 

Design;  Multifactorial  (Ref.  5f  page  323) 
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Results 

Remarks ; 

1.  All  main  effects  are  confused  with  interactions. 

2.  All  Interactions  are  assumed  negligible. 
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Table  23 


1.  All  main  effects  are  confused  with  interactions. 


2.  All  interactions  are  assumed  negligible. 
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Table  24 


2.  All  intarmctlons  are  seoumed  negligible. 


Remarks  t 


1.  All  Bain  effects  ex9  confused  with  Interactions. 

2.  All  interactions  are  assumed  negligible. 

3.  The  treatment  combinations  in  the  individual  rows  of  this 
design  can  be  used  In  any  combination  of  two  or  more,  up 
to  and.  including  15  treatments. 
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He mark a  I 


1.  All  main  effects  are  confused  with  interactions. 

2.  All  interactions  are  assumed  negligible. 

,3.  Ibe  treatment  combinations  in  the  individual  rows  of  this  desi^ 
can  be  used  in  any  combination  of  two  or  moro,  up  to  and  in- 
cl\]dlng  ,19  treatments. 
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Table  27 

23  Treetsteat  end  24  Ite^ 

Dsslga:  Moltifactorlal  (Ref.  3$  P*€^  323) 


Reciarks:  1..  All  ma-in  effects  are  confused  with  Interactions. 

2.  All  Interactions  are  assumed  negligible. 

3.  The  treatment  combinations  in  the  individual  rows  of  this  design  can  be  us< 
combination  of  two  or  more  up  to  and  including  23  treatments. 
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Table  31 

6  Treatiaents  and  32  Items 

Deslga:  l/2  Z  2^  Factorial  (Ref.  page  6) 
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7  Treatments  and  32  Items 

Design;  l/4  X  2^  Factorial  (Ref.  6,  page  19) 


(  iTeAtoeats  and  32  Items 

SeslQi:  l/k  X  2^  Factorial  (Ref.  6,  page  19) 
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Table  36 

d  Treatments  and  32  Items 

Design:  I/8  X_2®  Factorial  (Ref.  6,  page  3I) 
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Table  43 

10  Treatments  and  32  Items 

Design:  l/32  X  2*®  Factorial  (Ref.  6,  page  52) 
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Remarks;  1.  All  main  effects  are  clear  of  tvo-lactor  interactions. 

2.  Hone  of  the  two-factor  intera^-i  lons  are  measurable.. 

3.  All  tlireeri'actor  and  fngher  ...rder  interactions  aie  assumed  negligible 
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effects  are  clear  of  tvo-f actor  Interactions. 

.he  tvo-factor  interactions  are  measurahle. 

f-factor  and  higher  order  interactions  are  assumed  negligible 


Table  45 

12  Treatuents  aiid  32  Iteos 

Deslga:  l/l26  X  2'^  Factorial  (Ref.  6,  pace  65) 


Remarks:  1.  All  main  effects  are  clear  of  two-factor  interactions. 

2.  None  of  the  two-factor  interactions  are  measurable. 

3.  All  three-factor  and  higher  order  interactions  are  assumed  negligible 


Table  hS 

13  Treatoents  jmd  32  Items 

Deslga:  X  2^3  FactorieJ.  (Ref.  6,  poQs  7^^) 


Remarks:  1.  All  main  effects  are  clear  of  tvo-f actor  interactions. 

£.  None  of  the  tvo-f act or  Interact 1(hi8  are  measurable. 

3.  All  three-factor  and  higher  order  interactions  are  assvuned  negligible 


Table  47 

31  Treatments  and  32  Items 
Design;  Mnltlfactorlal  (Ref. 
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PREFACE 


This  handbook  is  intended  as  a  guide  for  determining  reliability  of  functioning  charact^^.istics 
of  weapon  components  by  testing  to  failure. 

Component  reliability  of  weapon  systems  i;  basically  a  function  of  engineering  design.  Margins 
of  safety  used  in  engineering  design  to  create  high  reliabilities  must  be  measured  by  testing  to  failure 
techniques  to  obtain  unbiased  estimates  of  reliability. 

The  author  does  not  hold  that  the  concepts  and  principles  presented  herein  are  final.  Revisions 
will  inevitably  be  made  as  the  state  of  the  art  advances. 
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